-- Logs begin at Tue 2022-07-05 12:05:59 UTC, end at Tue 2022-07-05 13:19:28 UTC. -- Jul 05 12:37:40.375475 dv-cinder-797608-48-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 12:37:40.384384 dv-cinder-797608-48-smb devstack@keystone.service[86687]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 12:37:40 2022] *** Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: nodename: dv-cinder-797608-48-smb Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: machine: x86_64 Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: clock source: unix Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: pcre jit disabled Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: detected number of CPU cores: 4 Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: current working directory: / Jul 05 12:37:40.386432 dv-cinder-797608-48-smb devstack@keystone.service[86687]: detected binary path: /usr/bin/uwsgi-core Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: your processes number limit is 47680 Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: your memory page size is 4096 bytes Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: detected max file descriptor number: 2048 Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: lock engine: pthread robust mutexes Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: thunder lock: enabled Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 12:37:40.387137 dv-cinder-797608-48-smb devstack@keystone.service[86687]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 12:37:40.431323 dv-cinder-797608-48-smb devstack@keystone.service[86687]: Python main interpreter initialized at 0x55bd764fa9c0 Jul 05 12:37:40.431323 dv-cinder-797608-48-smb devstack@keystone.service[86687]: python threads support enabled Jul 05 12:37:40.431323 dv-cinder-797608-48-smb devstack@keystone.service[86687]: your server socket listen backlog is limited to 100 connections Jul 05 12:37:40.431323 dv-cinder-797608-48-smb devstack@keystone.service[86687]: your mercy for graceful operations on workers is 90 seconds Jul 05 12:37:40.431690 dv-cinder-797608-48-smb devstack@keystone.service[86687]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 12:37:40.431767 dv-cinder-797608-48-smb devstack@keystone.service[86687]: *** Operational MODE: preforking *** Jul 05 12:37:40.432006 dv-cinder-797608-48-smb devstack@keystone.service[86687]: *** uWSGI is running in multiple interpreter mode *** Jul 05 12:37:40.432006 dv-cinder-797608-48-smb devstack@keystone.service[86687]: spawned uWSGI master process (pid: 86687) Jul 05 12:37:40.432211 dv-cinder-797608-48-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 05 12:37:40.433317 dv-cinder-797608-48-smb devstack@keystone.service[86687]: spawned uWSGI worker 1 (pid: 86702, cores: 1) Jul 05 12:37:40.433317 dv-cinder-797608-48-smb devstack@keystone.service[86687]: spawned uWSGI worker 2 (pid: 86703, cores: 1) Jul 05 12:37:40.433317 dv-cinder-797608-48-smb devstack@keystone.service[86687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 12:37:45.884895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:37:45.884895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: from cryptography.utils import int_from_bytes Jul 05 12:37:45.885698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:37:45.885698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: from cryptography.utils import int_from_bytes Jul 05 12:37:45.885698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:37:45.885698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: from cryptography.utils import int_from_bytes Jul 05 12:37:45.886204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:37:45.886204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: from cryptography.utils import int_from_bytes Jul 05 12:37:45.934469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:37:45.934616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:37:45.934710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:37:45.934800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:37:45.934872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] command line args: [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:37:45.934946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] command line args: [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:37:45.935117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:37:45.935236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:37:45.935315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ================================================================================ {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:37:45.935439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ================================================================================ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:37:45.935541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] admin_token = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.935714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] admin_token = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.935797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] config_dir = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.935961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] config_dir = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] config_source = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] debug = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] config_source = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] debug = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.936973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.937905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_config_append = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_config_append = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_dir = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_file = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_dir = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.938993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.939963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.940936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.941849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] publish_errors = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] publish_errors = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.942994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.943915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] standard_threads = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] standard_threads = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] use_journal = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.944942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] use_json = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] use_journal = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] use_stderr = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] use_json = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] use_syslog = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] use_stderr = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] use_syslog = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.945914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.946030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:37:45.946141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.946772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.946938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.947979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.948922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.949949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.950885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.951923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.952991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.953905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.954926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.955971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.956930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.957974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.958995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.959912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.960993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.961943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.962624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.962816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.963914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.964807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.965969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.966908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.967930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.968881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.969917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.970948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.971978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.external = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.external = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.972954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.password = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.token = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.password = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] auth.token = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.973996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.974939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.975884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.976891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.977859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.978019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.978191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.978368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.978647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.978844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.979926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.980975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.981898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.982954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.983891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.984990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.985922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.986975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.987887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.988955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.989984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.990897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.991926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.992972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.993102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.993252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.993455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.993643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.993829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.994932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.995958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.996994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.997918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.998980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:45.999905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.000861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.001895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.002928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.003972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.004907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] role.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] role.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.005958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] role.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.006989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] role.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.007676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.008282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.008410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.008511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.008607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.009274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.009441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.009608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.009801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.009968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.010902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.011901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.012859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.013902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.014943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.015931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.016939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.017987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.018985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.019966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.connection = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020560 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.020955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.021951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:37:46.022627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:37:46.050636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.050862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.051095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.051354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.051587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.051816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.059887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.060904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.088065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.088285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.088963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.089197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.231136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.231646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.280569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.280820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.282508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.282742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.344321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.344548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.344877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.344968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.345808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.346025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.370718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.370946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.371898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.372023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.372110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.372235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.382978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.383424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.395664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.395896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.396924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.397007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.397137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.397349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:37:46.414548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.414757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:37:46.415113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.415216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.415354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:37:46.415477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:37:46.415715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.415976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.416058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.416232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.416314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:37:46.416483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.416565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.416804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.417069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.417331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.427258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.427533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.427800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.428079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.428206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.428486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.428779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.429064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.436311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.437611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.439590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.439863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.440140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.440418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.440718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.440913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.441025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.441824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.442798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.443068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.443341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.443606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.469282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.470885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.470969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.471160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.472572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.472875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.476447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.476757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.477152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.479552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.479835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.480231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.485406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.485641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.487797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.488082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.490085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.490371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.490651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.490928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.491200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.491472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.491739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.492004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.492855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.493359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.493877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.494335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.494889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.495387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.495889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.496334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.511122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.511390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.515953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.516040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.516233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.519622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.519916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.520878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.524695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.525081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.525278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.528906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.530221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.532493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.532814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.533107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.533404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.533689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.533879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.533962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.537519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.537819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.538112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.538400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.538682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.538967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.553771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.554050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.554314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.554573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.558832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.559113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.559381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.559647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.562531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.564230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.564523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.567575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.567698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.567973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.568249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.568527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.568881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.569297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.569573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.573429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.573710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.573996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.574278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.574555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.582748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.583024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.583303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.583580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.583856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.585456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.585755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.588100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.588379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.588662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.588963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.589243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.590842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.591137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.604087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.607609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.609936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.610932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.612663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.613217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.614312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.614588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.614872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.616538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.618615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.620004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.620283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.620571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.622305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.623906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.627143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.627433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.627829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.627960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.628109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.629589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.632817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.633109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.633506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.634432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.637860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.638145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.638423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.643479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.643766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.644051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.646255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.646537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.646811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.647083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.647352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.647734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.648009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.648281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.648550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.648852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.649131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.649489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.649916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.650009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.652104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:37:46.652379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.652657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.652952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.653224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.653594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.653875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.654155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.654438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.654710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.654996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.655262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.655536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.655805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:37:46.687988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd764fa9c0 pid: 86702 (default app) Jul 05 12:37:46.691341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e4c0-2f81-411c-913c-3051e3f39af5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:46.691637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e4c0-2f81-411c-913c-3051e3f39af5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:46.691921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e4c0-2f81-411c-913c-3051e3f39af5 None None] PATH_INFO: `/v3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:46.694150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd764fa9c0 pid: 86703 (default app) Jul 05 12:37:46.696106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Jul 5 12:37:46 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:37:55.369218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:55.369743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:55.369743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:55.374033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:37:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:37:55.379332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:55.379752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:55.379893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:55.450580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: INFO dbcounter [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] Registered counter for database keystone Jul 05 12:37:55.471666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:37:55.478543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writer thread running {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:37:55.655391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG passlib.handlers.bcrypt [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 12:37:55.655729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG passlib.handlers.bcrypt [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 12:37:55.709384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:37:55.711009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:37:55.831446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:37:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 05 12:37:56.076316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:37:56.148535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: INFO dbcounter [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] Registered counter for database keystone Jul 05 12:37:56.169975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG oslo_db.sqlalchemy.engines [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:37:56.176980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writer thread running {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:37:56.316244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbda9-ba75-4d1c-bad8-cc9d6dd09c3e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:37:56.323591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:37:56.324264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:56.324547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:56.324871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:56.334064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:37:56.392392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 12:37:56.393077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c1e3e-4ba0-4aec-8f72-80c89a46180f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:37:56.404040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Jul 5 12:37:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:37:56.412025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:37:56.426618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35157-61ea-42ab-994d-fb4ed5b993d4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:37:56.431176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:37:56.432302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:56.432592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:56.432905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] PATH_INFO: `/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:56.437044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=64ba694b123b4c2a9ad28d0d2ae13d58)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:37:56.490348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 12:37:56.501829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06667c0-3d43-45fd-bbdb-9abf147f12d3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:37:56.501829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Jul 5 12:37:56 2022] GET /identity/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:37:58.522888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2390-a910-4213-b1fc-2785fd71cb9b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:58.523421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2390-a910-4213-b1fc-2785fd71cb9b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:58.523421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2390-a910-4213-b1fc-2785fd71cb9b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:58.527746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:37:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:37:58.533102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d784-094c-4510-987a-f34a538d232e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:58.533579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d784-094c-4510-987a-f34a538d232e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:58.533666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d784-094c-4510-987a-f34a538d232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:58.552752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-77e8d784-094c-4510-987a-f34a538d232e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:37:58.554285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-77e8d784-094c-4510-987a-f34a538d232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:37:58.562889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:37:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 12:37:58.584756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2390-a910-4213-b1fc-2785fd71cb9b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:37:58.596921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2390-a910-4213-b1fc-2785fd71cb9b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:37:58.601113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:37:58.601746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:58.602551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:58.602834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:58.611207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:37:58.613018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e7d87-0079-480d-85c9-208658e51f04 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:37:58.622339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Jul 5 12:37:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:37:58.627629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d784-094c-4510-987a-f34a538d232e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:37:58.636636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d784-094c-4510-987a-f34a538d232e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:37:58.641061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:37:58.641925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:37:58.642211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:37:58.642491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:37:58.643885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:37:58.645751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228325e-80e3-4c22-a7d4-9aab7c708803 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:37:58.647297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Jul 5 12:37:58 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:00.738992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1b06-80c1-4ab6-84e1-e9ce35525a86 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:00.739541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1b06-80c1-4ab6-84e1-e9ce35525a86 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:00.739665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1b06-80c1-4ab6-84e1-e9ce35525a86 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:00.741075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:00.746370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:00.746807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:00.746935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:00.748630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b570-37b3-45c3-beac-8d6ba5262888 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:00.748959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b570-37b3-45c3-beac-8d6ba5262888 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:00.749243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132b570-37b3-45c3-beac-8d6ba5262888 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:00.750533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:00.755252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:00.755541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:00.755823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:00.764527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:00.765807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:00.796155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG passlib.handlers.bcrypt [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 12:38:00.796577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG passlib.handlers.bcrypt [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 12:38:00.842380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:00.843975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:00.846004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:00.870588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:00.893485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:00.947252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:00.969152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:00.974113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387809bc-7818-4fec-9207-0a4d077f2180 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.007903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.009465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.009755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.010045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.021693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:01.033721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:01.034606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:01.035407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:01.040841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.074704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99b14-3324-4bb6-8cd4-f32a766c6652 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.076967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.111493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129dbb-8903-4d38-b242-553262962218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.112435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129dbb-8903-4d38-b242-553262962218 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.112756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129dbb-8903-4d38-b242-553262962218 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.113043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129dbb-8903-4d38-b242-553262962218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.122404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.140455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7aa8-a61c-4a28-8404-0a6b37f6e0c6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.172947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.173623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.173905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.174185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.174942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:01.175251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.176650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.181867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129dbb-8903-4d38-b242-553262962218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.183394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129dbb-8903-4d38-b242-553262962218 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.188873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:01.194300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.281193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:38:01.286695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129dbb-8903-4d38-b242-553262962218 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.290636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.294243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a6fa-6893-43c9-b230-d1329340b625 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.327626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.328512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.328841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.329131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.330359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.331825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.333494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:01.339421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.354013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.387959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129dbb-8903-4d38-b242-553262962218 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.421955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.422759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.423058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.423337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.437122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf8e9-9a6a-444a-b3d4-e40743c68933 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.442612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.444091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:38:01.464773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:01.465716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:01.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:38:01.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:38:01.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:38:01.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:01.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:01.471198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.471781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.472008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.472299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.472581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.473808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.475269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.477579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:01.483131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:01.537513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.565529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:01.581406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684559-7113-4c3d-a697-c7ca2b3c71a0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.584717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b272-d4a7-4bc1-a631-b3844637a532 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:01.615345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.616009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.616292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.616570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.617332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:01.617643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.618691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:01.619141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116204e-2326-4a95-a33e-8a4aac5034f0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.619353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:01.619634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:01.619905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:01.620782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.domain.id=default, user.id=c80e1d4e886445cc85f651f6ae073c71) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:01.621098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:01.623710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633e80-9f46-4664-84df-0b8416d630d0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:01.629474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/role_assignments?user.id=c80e1d4e886445cc85f651f6ae073c71&scope.domain.id=default&role.id=ebbfe49b13964adab174b6721d50a779 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:01.637946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:03.984567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527967f1-f234-4e6d-9aaf-2ab7ef98cd4e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:03.985098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527967f1-f234-4e6d-9aaf-2ab7ef98cd4e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:03.985172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527967f1-f234-4e6d-9aaf-2ab7ef98cd4e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:03.986523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:03.991868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae030-516e-4f00-bcd0-cfd46005e8d5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:03.992273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae030-516e-4f00-bcd0-cfd46005e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:03.992474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae030-516e-4f00-bcd0-cfd46005e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.014349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-81dae030-516e-4f00-bcd0-cfd46005e8d5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:04.015571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-81dae030-516e-4f00-bcd0-cfd46005e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:04.101329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:04.118793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5d76-523b-4008-acb4-b950dc22e0c2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.119387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5d76-523b-4008-acb4-b950dc22e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.119880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5d76-523b-4008-acb4-b950dc22e0c2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.121506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:04.126827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b2a9-0ca1-4d2f-8fd8-035da0c2b65a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.127367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b2a9-0ca1-4d2f-8fd8-035da0c2b65a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.127862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b2a9-0ca1-4d2f-8fd8-035da0c2b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.141710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a5d76-523b-4008-acb4-b950dc22e0c2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.157615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e347b2a9-0ca1-4d2f-8fd8-035da0c2b65a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:04.160318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e347b2a9-0ca1-4d2f-8fd8-035da0c2b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:04.231547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:04.272259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:04.272259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407204-e62f-44c9-bccc-dd80d194c6d4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.272259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407204-e62f-44c9-bccc-dd80d194c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.272259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407204-e62f-44c9-bccc-dd80d194c6d4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.272259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:04.277196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.277501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.277789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.287523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a5d76-523b-4008-acb4-b950dc22e0c2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.296934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:04.298154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:04.335744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.337305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.337822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.338307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.349531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:04.357961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:04.358791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:04.359544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:04.361872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 14/27] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:04.362870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.368021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:04.378865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:04.379730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.478916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71df97-3ab7-458b-9558-df4238b1dd5f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.506747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b34cb-f9fb-43f8-ba76-a7a02e8b6d6c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.514827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:04.531479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.531479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.531479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.531479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.538199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:04.539910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:38:04.561906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:04.562749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:04.563533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:38:04.563533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:38:04.563533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:38:04.563533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:04.563533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:04.564185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.581463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.582446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.582744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.583024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.583827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:04.584142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:04.585652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:04.603099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:04.604241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.646180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:04.699786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d239c-eec2-4505-b594-153476d4dd9b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.717162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a91536-0d41-4a55-9bb7-8ffc6c268980 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.739193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.739879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.740276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.740562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.741390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:04.742845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e8298-5013-4b4b-9e25-0b1409911664 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:04.756177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:04.761454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4664-e1b9-4593-850a-02fcef9d7e95 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1bb41-6983-4f07-b5d9-03e33ae44835 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1bb41-6983-4f07-b5d9-03e33ae44835 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1bb41-6983-4f07-b5d9-03e33ae44835 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 17/32] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:04.777079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1bb41-6983-4f07-b5d9-03e33ae44835 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.808595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:04.885734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1bb41-6983-4f07-b5d9-03e33ae44835 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:04.924885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:04.926029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.926494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.927072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.928871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:04.931033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:04.932946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 18/33] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:04 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:04.933886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:04.963563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 16/34] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 5 12:38:04 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:04.965214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:04.965594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:04.965949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:04.987241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:04.989925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:05.083236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 17/35] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:05.084397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:05.141957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:05.145862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:05.157249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4ab4d-8d07-49df-940e-113d6de6e261 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:05.215496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e693ad-2244-4923-baf6-e77389fae894 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:05.239285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:05.240614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.241012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.241293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.242351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:05.245250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4344-f017-4ee8-987c-42b1897f177c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:05.255998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:05.257117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.257610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.258103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.259625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:05.261490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:05.263334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 18/36] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:05.269310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:05.382622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f488-9d85-4a9e-86fe-404e5069e435 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:05.396553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:05.419668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:05.419668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.419668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.419668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.423763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:05.423763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:05.503261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 5 12:38:05 2022] POST /identity/v3/roles => generated 225 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:05.504514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:05.537944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 19/38] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:38:04 2022] POST /identity/v3/projects => generated 301 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:05.622692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549935e4-286f-4124-a974-152b57426fcd None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.623033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549935e4-286f-4124-a974-152b57426fcd None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.623277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549935e4-286f-4124-a974-152b57426fcd None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.624775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 20/39] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:05.629933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859073-4d54-4d80-b57c-899252f2e315 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:05.642926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2b3-2ed9-479a-aa45-007546fccae3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.643104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2b3-2ed9-479a-aa45-007546fccae3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.643389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2b3-2ed9-479a-aa45-007546fccae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.679294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3ecfc2b3-2ed9-479a-aa45-007546fccae3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:05.682175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ecfc2b3-2ed9-479a-aa45-007546fccae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:05.690182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:05.691121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.691415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.691698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] PATH_INFO: `/v3/domains/default/users/c80e1d4e886445cc85f651f6ae073c71/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.697710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c80e1d4e886445cc85f651f6ae073c71, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:05.699254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:05.777502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 21/40] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:05.791024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbff0-1e7d-409e-8a10-cd2d3cf2b923 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.791318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbff0-1e7d-409e-8a10-cd2d3cf2b923 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.791599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fbff0-1e7d-409e-8a10-cd2d3cf2b923 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.793067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 22/41] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:05.798125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.798474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.798767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.807011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Jul 5 12:38:05 2022] PUT /identity/v3/domains/default/users/c80e1d4e886445cc85f651f6ae073c71/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:05.807670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:05.817421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:05.818943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:05.851438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:05.899386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:05.923235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:05.927889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c484-f2a7-4989-b66c-3ce388a81048 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:05.933978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:05.970970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:05.971799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:05.972153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:05.974390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:05.974390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:05.974956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936855e-6a65-4b89-bed1-23065f89d0f4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:06.030335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f1f21-4fdd-4556-8e87-995aee4e0515 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:06.063317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:06.064126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:06.064416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:06.064723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:06.065999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:06.067526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:06.069183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 24/44] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:06.077765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:06.080493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 21/45] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 5 12:38:05 2022] POST /identity/v3/roles => generated 223 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:06.166644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:06.193126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971e4c-31da-404f-b39d-b622ffe6f233 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:06.233795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:06.234552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:06.234926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:06.235038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:06.235782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:06.237295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa31b0-6281-4c96-bd52-0f5f6bdb0d1f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:06.361349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:38:06 2022] POST /identity/v3/projects => generated 312 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:38:07.906921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7431f-87ec-440a-ad72-df794312b48f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:07.907435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7431f-87ec-440a-ad72-df794312b48f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:07.907607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7431f-87ec-440a-ad72-df794312b48f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:07.909030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:07.915349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:07.915770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:07.916002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:07.932976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:07.934172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:08.001026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:08.025886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7431f-87ec-440a-ad72-df794312b48f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.120098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:08.127284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7431f-87ec-440a-ad72-df794312b48f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.268311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.269198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.269607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.269895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.281028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a6e239b6-f554-4573-9ce9-ef8679abeee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:08.288825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:08.292631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:08.293406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 23/49] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:08.296181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.355063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:08.386710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79960-3760-4eb0-937d-ab880697d6a6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.387000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79960-3760-4eb0-937d-ab880697d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.387278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79960-3760-4eb0-937d-ab880697d6a6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.388648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 24/50] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:08.393595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.393885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.394163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.397520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cb653-78bf-4692-8aec-96585d09908e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.411282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:08.412480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:08.433328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.434006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.434295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.434573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.435336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:08.435644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.437066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:08.445041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 27/51] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:08.451095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.479054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 25/52] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:08.501927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.590238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:08.606731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16291274-3a2b-4f8f-8885-ffd2c2e6afe3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.644890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.645804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.646160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.646446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.647646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.649195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:08.650827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:08.654875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a593e7b-c166-4466-93f7-28c62382a128 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.656300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.676307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:08.690853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.691739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.692027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.692306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.693533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.695001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:08.697606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 28/54] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:08.703063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.756233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f01e94-aef0-4c10-8291-d61ffa411d1c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.791683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.792358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.792649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.792971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.793696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.795159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58348d-f89e-427d-8e98-6d1aa91f28e1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:08.801714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4002-9553-49da-928e-dba01712f4a8 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.835710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.836592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.836953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.837295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.838491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.839943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:08.841714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:08.847335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:08.880526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 27/56] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Jul 5 12:38:08 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:38:08.908923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:08.956643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c722cf-cb59-4cec-b273-e535b1b4258a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:08.993179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:08.993871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:08.994161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:08.994443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:08.995309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.domain.id=default, user.id=c80e1d4e886445cc85f651f6ae073c71) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:08.995629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:08.997152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7d9c-a508-4046-9895-3d5216bf3795 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:09.007113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 30/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Jul 5 12:38:08 2022] GET /identity/v3/role_assignments?user.id=c80e1d4e886445cc85f651f6ae073c71&scope.domain.id=default&role.id=ebbfe49b13964adab174b6721d50a779 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:10.927508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768c8f-edd2-4883-91a7-3869af69fcaf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:10.928026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768c8f-edd2-4883-91a7-3869af69fcaf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:10.928111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768c8f-edd2-4883-91a7-3869af69fcaf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:10.929488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:10.935126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:10.935540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:10.935690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:10.952599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:10.953813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:11.018420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:11.043001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26768c8f-edd2-4883-91a7-3869af69fcaf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:11.046791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:11.142096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26768c8f-edd2-4883-91a7-3869af69fcaf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:11.174130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:11.174910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:11.175194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:11.175470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:11.176645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:11.178179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb3a6-ff8d-48c2-b574-9c726dff6c50 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:11.180340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:11.185941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:11.233794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:11.283124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7959a78-e54f-47af-92de-51382a60b647 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:11.316434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:11.317129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:11.317416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:11.317751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:11.318445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:11.319895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21daa7-f071-4157-a8a1-f3fdf3a9d4ae None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:11.403506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:11 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:14.551748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180718-e19f-456b-8284-ef18592213aa None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.552299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180718-e19f-456b-8284-ef18592213aa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.552299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180718-e19f-456b-8284-ef18592213aa None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.553970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:14.560070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.560477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.560645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.584387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:14.585639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:14.603262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb052-d01a-4f01-a6c9-c0c33fc4f0eb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.603598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb052-d01a-4f01-a6c9-c0c33fc4f0eb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.603832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb052-d01a-4f01-a6c9-c0c33fc4f0eb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.605385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:14.610668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326df0-aa44-4cb9-af01-b012234b7fc0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.610983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326df0-aa44-4cb9-af01-b012234b7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.611246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326df0-aa44-4cb9-af01-b012234b7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.638624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-19326df0-aa44-4cb9-af01-b012234b7fc0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:14.639844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-19326df0-aa44-4cb9-af01-b012234b7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:14.687185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:14.712023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:14.770793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:14.771778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:14.798931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d513b-c185-452b-84cd-2e6791625b38 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.799252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d513b-c185-452b-84cd-2e6791625b38 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.799513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d513b-c185-452b-84cd-2e6791625b38 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.801627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 33/66] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:14.809450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d513b-c185-452b-84cd-2e6791625b38 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:14.812658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:14.851203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0de5-e6a5-4d89-baba-11698f2ab3ed None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:14.890024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:14.891163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.891722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.892178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.904835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c20eb57a-bd22-4563-b77e-67699eecb9c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:14.915177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:14.916056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:14.916849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:14.919335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 34/67] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:14.920931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.921429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.921907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:14.943197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:14.944745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:14.945254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d513b-c185-452b-84cd-2e6791625b38 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:14.994186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:14.995021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:14.995316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:14.995598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.010680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:15.019189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:15.020045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:15.021234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 34/68] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:15.024652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.027206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 35/69] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:15.028322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.073342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.110918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.153228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cdf8-b40b-47e7-a0ad-3644deb825f2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.157165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0547543-4dc3-4032-9397-cdae014a088b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.188850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.189540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.189833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.190118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.190884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:15.191199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.192610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.194249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.194966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.195251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.195531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.196297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:15.196612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.198036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0067d-500f-4133-a389-ac1ebd21d214 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.205957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 35/70] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:15.205957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.210054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:15.212713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7853a-7a94-475c-b145-137b1c9674b8 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.212713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7853a-7a94-475c-b145-137b1c9674b8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.212713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7853a-7a94-475c-b145-137b1c9674b8 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.213251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 37/72] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:15.215200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7853a-7a94-475c-b145-137b1c9674b8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.306465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.307997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea12d62-43a2-44e4-9e4f-0fd86bf8a0c1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.318685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7853a-7a94-475c-b145-137b1c9674b8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.331645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.342636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.343442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.347606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.347606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.354187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.354675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:15.355077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.355368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.355651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4fe8fd53-eab6-46f6-946f-a9023ec64dd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:15.362490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:15.363422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:15.364215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:15.365404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff53d5-d35b-4d46-bd7b-a9835ee6b2bf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.365404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff53d5-d35b-4d46-bd7b-a9835ee6b2bf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.365555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff53d5-d35b-4d46-bd7b-a9835ee6b2bf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.368724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 37/74] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:15.368724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff53d5-d35b-4d46-bd7b-a9835ee6b2bf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.373888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.375367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc862-4e82-4289-8633-46c8c3393011 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.377104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:15.378310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.378604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.378887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.396170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:15.397405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:15.463608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:15.464436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.469476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff53d5-d35b-4d46-bd7b-a9835ee6b2bf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.504759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.505645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.505935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.506217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.507434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.509463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627b5e6-ff77-4f63-ab4d-e4bb0458904b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.511100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 38/77] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:15.512248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.512538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.512847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.528428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:15.529663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:15.553905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.577398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.578107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327cd0-7a3d-4296-bb78-5ee5359b6aa6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.597509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:15.598388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.613872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.614559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.614849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.615131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.615888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:15.616203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.618208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.626514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 40/79] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:15.627313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.701911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72411-4e6b-402f-9d92-1798b209829c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.725022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03de8b9-4603-4b0b-a72d-0d64cb2b82fe None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.736063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.736746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.737037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.737316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.759362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.760165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.760461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.760771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.767729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.771894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:15.779856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:15.780752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:15.781523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:15.782131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.789604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.808095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.809690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.879362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485143-ebe0-43a4-b12e-7055a1048f96 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:15.907863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 40/81] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:15.908723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:15.914202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:15.915052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:15.915339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:15.915616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:15.980010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:15.984213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:15.986388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:15.989449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.006860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02789d05-25bf-407d-8ce9-668e82dd57b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.042369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.043173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.043453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.043731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.044966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.046541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.052423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 41/82] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.052423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.087386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:16.088243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.151312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714cd56-3c76-4a07-80d3-9793d3270274 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.184764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.185005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.185648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.186056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.186214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.187425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.188903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.189211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf373f1-0a9e-43c1-b03a-f479ab6e9f9f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.201014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 42/84] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.201014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.209981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.223401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.224085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.224373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.224649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.225446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:16.225754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.227458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.235593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 43/85] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.236361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.292515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce219c4-e652-4c21-938a-a3d39b070161 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.326823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.327698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.327990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.328278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.329524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.331002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.332727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 43/86] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.333500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.342318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965677-76da-4752-930d-5d630b88e8f5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.376251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.376966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.377260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.377543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.378273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.379728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.416568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.431176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc8ee-2fc7-44eb-b633-64c32aa231b9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.450597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 44/87] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:16 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:16.451525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.466958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.468109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.468454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.468830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.470342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.472162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.472922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.475180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.475928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.567254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37c708-7a45-4d1a-a6ae-f63eeef058ad None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.596297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b5c6-f62b-4804-9984-34b3d8f8ac3e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.605586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.606347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.606641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.606917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.642737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.643755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.644164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.644450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.646704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.648393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.650352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.651037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.681902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.701197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.702666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.722173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:16.779858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7604a0a-d660-4aee-a833-e14ce231f657 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:16.822623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:16.823611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:16.824014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:16.824698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:16.825003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:16.825282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:16.826332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:16.827512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:16.829100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:16.838287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:16.839053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:17.004067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:17.025234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c2889-4394-49cc-b0ea-fdcfc9cb72e4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.039556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098225-0258-429c-a0c5-1cea9b9fe1a7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.057811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:17.088035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.088760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.089053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.089333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.090260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:17.090574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.092043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.104561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.105264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.105552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.105829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.107060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 46/92] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:17.108234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:17.211888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.213488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.309270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:17.326440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:17.334002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:17.351176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de34b8-1d72-4c6c-8b12-22a622258406 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.423213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.424096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.424380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.424657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.428189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.429794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.431650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 47/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:17 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:17.438237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:17.529627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57086a58-8164-4250-8769-9f6da1fbaf4b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.535340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:17.586059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.586925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.587209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.587494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] PATH_INFO: `/v3/projects/f5d2d2d7be2c49f09999af2879b4d251` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.588763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] RBAC: Authorizing `identity:get_project(project_id=f5d2d2d7be2c49f09999af2879b4d251)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.590258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.591988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 48/95] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:17 2022] GET /identity/v3/projects/f5d2d2d7be2c49f09999af2879b4d251 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:17.597695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:17.631487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5210550-6ab2-4ce2-a352-0000b0c3f797 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.656344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:17.704144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f36d-22af-4a09-8b13-897d3c5206dc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:17.721522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.722216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.722506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.722786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.723639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=c80e1d4e886445cc85f651f6ae073c71) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:17.723954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.725443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e09a4-ad17-4ee0-ad75-98a350f7905e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.738621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 48/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:17 2022] GET /identity/v3/role_assignments?user.id=c80e1d4e886445cc85f651f6ae073c71&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:17.743100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:17.743804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:17.744103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:17.744396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:17.745361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=f5d2d2d7be2c49f09999af2879b4d251, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:17.745741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:17.747295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d49b95-96be-4302-a259-605a60bd564f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:17.754202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 49/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:17 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=f5d2d2d7be2c49f09999af2879b4d251&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:19.624825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6523fd-2a9b-417f-b585-bdcce3787e6a None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:19.625639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6523fd-2a9b-417f-b585-bdcce3787e6a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:19.625767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6523fd-2a9b-417f-b585-bdcce3787e6a None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:19.628407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 49/98] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:19.651765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:19.653421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:19.654206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:19.665701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be012-e3a2-4b4e-8369-950d45d0bf60 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:19.666037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be012-e3a2-4b4e-8369-950d45d0bf60 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:19.666320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be012-e3a2-4b4e-8369-950d45d0bf60 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:19.668594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 50/99] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:19.676730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:19.676730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:19.676730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:19.694644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:19.697943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:19.703354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:19.705400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:19.859391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:19.869470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:19.904585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:19.949217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.029344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.088795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.189991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81246e-8d5a-4fa6-9926-b975fab2fdad None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.206960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4bd6a-1cc6-4320-95d6-af91ea548663 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.260227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.262402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.264909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.266770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.291061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.291880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.292166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.292445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.293461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:20.293698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:20.295191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe137e4-d18b-421f-9443-7dd47b34e70b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:20.296904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 51/102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8ff-5ada-430f-b60a-51289d151964 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8ff-5ada-430f-b60a-51289d151964 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8ff-5ada-430f-b60a-51289d151964 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 52/103] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785573-8710-4990-b567-a41a22509924 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.303202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785573-8710-4990-b567-a41a22509924 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.303604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785573-8710-4990-b567-a41a22509924 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.303604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 53/104] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-622609a1-5245-4d84-b267-2104bb0d5cb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:20.308316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:20.309257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:20.310055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:20.310659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96785573-8710-4990-b567-a41a22509924 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.312599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 52/105] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:20.314455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fda08-7f7b-4d20-951e-8be58431ea0c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.314750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fda08-7f7b-4d20-951e-8be58431ea0c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.315034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fda08-7f7b-4d20-951e-8be58431ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.337305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d94fda08-7f7b-4d20-951e-8be58431ea0c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:20.338563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d94fda08-7f7b-4d20-951e-8be58431ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:20.408707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 53/106] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:20.410153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.410461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.410750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.427764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:20.428983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:20.430112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96785573-8710-4990-b567-a41a22509924 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.457113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.457715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.465326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.466004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.466291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.466595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.467438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:20.469042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:20.499436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 54/107] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:20.501627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.562108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 54/108] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:38:20 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:20.563305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.627713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ace6-01d9-4d18-ba50-a9baaddf400b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.684527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.685239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.685525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.685808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.686571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:20.686880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:20.688276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:20.693334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05989296-0666-4907-817f-fbdddcabee6f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.698686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 55/109] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:20.699580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.733651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.749802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.750646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.750934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.751212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.763707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:20.774575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:20.775542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 55/110] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:20.777198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.823694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:20.863527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c29-d428-49b2-87cb-2fdb5a3ab7c5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.908652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.908898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512686f6-cf60-4671-b248-37782ffdf511 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:20.909512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.909798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.910074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.927015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:20.940706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:20.941619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 56/111] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:20.942375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:20.949432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:20.950328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.950668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.950953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.952535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:20.953714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc56d3-7236-41ab-8974-7282a0b32c6b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:20.955640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 56/112] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:20.961484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567723-8de4-4a13-9a20-41b485798cec None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:20.961730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567723-8de4-4a13-9a20-41b485798cec None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:20.962021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567723-8de4-4a13-9a20-41b485798cec None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:20.963490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 57/113] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:20.964153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567723-8de4-4a13-9a20-41b485798cec None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.044800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.060591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264b65c-3134-463a-8488-a79f23f3954a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.073662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.080511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567723-8de4-4a13-9a20-41b485798cec None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.095670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.096350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.096777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.097065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.097830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:21.098146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.099552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.109652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 57/114] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.110264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.116950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.117633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.117922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.118210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.118957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:21.119268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.120685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141bb2-eb1a-408b-bcbe-4c51bcb5008f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.134541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 58/115] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.134541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dafb-03a0-423c-bc84-d9166e8e7860 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.134541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dafb-03a0-423c-bc84-d9166e8e7860 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.134541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dafb-03a0-423c-bc84-d9166e8e7860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.151814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f782dafb-03a0-423c-bc84-d9166e8e7860 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:21.153047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f782dafb-03a0-423c-bc84-d9166e8e7860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:21.218907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c9b20-8708-40f3-a6fa-1b796fb59899 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.220705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 59/116] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:21.228796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e37e6-c5d7-4aac-89c5-8eeaa057b1e6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.228796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e37e6-c5d7-4aac-89c5-8eeaa057b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.228796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e37e6-c5d7-4aac-89c5-8eeaa057b1e6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.228796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 60/117] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:21.228796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e37e6-c5d7-4aac-89c5-8eeaa057b1e6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.261113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.262089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.262387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.262792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.264056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.265534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.267472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 58/118] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.272190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.287096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.328386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.341885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e37e6-c5d7-4aac-89c5-8eeaa057b1e6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.380930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.381624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717f61-7916-4432-8889-59a85caa96c0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.381827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.382159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.382616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.384601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.385510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703e4c8-04e1-41c1-bcc6-0c2eb7060208 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.387331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.388470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.388786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.389305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.406539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:21.407589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:21.418768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.419673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.419960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.420240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] PATH_INFO: `/v3/users/ed01991703794241b6d21f1ec4b11bb5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.434791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] RBAC: Authorizing `identity:get_user(user_id=ed01991703794241b6d21f1ec4b11bb5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.436255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.442382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 59/120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/users/ed01991703794241b6d21f1ec4b11bb5 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.442382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.488722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:21.489582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.524271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.564911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff9a9-8a82-4436-9631-a54d4c61367a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.581594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.597265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a708-4957-42f0-99c8-55af81584d89 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.606896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.607440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.607982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.608492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.619075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:21.627062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:21.628306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:21.629104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.644151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e453-b977-42e0-9772-289b047b687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.645124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e453-b977-42e0-9772-289b047b687d None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.645410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e453-b977-42e0-9772-289b047b687d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.645686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e453-b977-42e0-9772-289b047b687d None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.647728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558e453-b977-42e0-9772-289b047b687d None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, user_id=7ead7d199ae44c578a5f8d7af3148e8d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.649841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558e453-b977-42e0-9772-289b047b687d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.728707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 63/123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:21 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:21.728707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e453-b977-42e0-9772-289b047b687d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.749230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf07a5-edc4-4467-8039-27315541ae44 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.783079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.788307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.789501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.794914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.794914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.794914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.794914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.795579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 61/124] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:21.796507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:21.848482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e453-b977-42e0-9772-289b047b687d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.892414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.893804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.894098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.894382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:21.917745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:21.954541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1e4ee-53ec-4b2c-95e9-28dc601313c0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:21.980172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:21.982254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:21.995609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:21.996603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:21.997028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:21.997743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.012480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:22.022566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:22.024269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:22.025416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:22.027224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 62/125] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:22.028419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.106716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.109339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 64/126] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:22.110004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.167509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.171349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c19e4-10bb-4ee1-a75d-9882e61ee141 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.222213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.223414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.224139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.224597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.225590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:22.226115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.227684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148b4fa-9fbd-42eb-8cd3-621196785443 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.227871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.237834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 63/127] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.239259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.264070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.265030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.265627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.265627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.267938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, user_id=7ead7d199ae44c578a5f8d7af3148e8d, role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.269440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.353534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03c4b6-844a-4471-8307-c854f21d2d57 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.354688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 65/128] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:22 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/26cba7b0722e440abff4c508da7eb0bb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:22.357794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.407705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.433499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.434592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.434890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.435174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.435969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:22.436285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.437827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.461485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 64/129] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.462874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.571808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c51e3-dab7-468f-b24e-4b8739a583fc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.580228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.611326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.612481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.612590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.612831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.614160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.615812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.619034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 66/130] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.624847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.627467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bf2c1-bf98-401c-a471-2c5d57b33ac1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.669787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.670935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.671227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.671508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.672969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.674618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.676388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 65/131] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.677286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.736176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71afd-ca8e-461c-83e5-9d9f0e78cd57 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.736697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.773792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.774698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.774991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.775274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.776528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.778149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.780204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 67/132] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.781004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.789268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45402e-1d8a-4cc7-8be7-6b465dd3e12c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.827027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:22.829614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.830549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.830980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.831491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.832538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=ed01991703794241b6d21f1ec4b11bb5) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:22.833022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.834709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.841080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 66/133] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/role_assignments?user.id=ed01991703794241b6d21f1ec4b11bb5&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=6b7436af028945c885cc804dfdcb3587 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.842385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.890523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f50c3-fe34-45e0-b6c7-e5d548339649 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.926323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:22.927222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:22.927516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:22.927803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:22.929080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:22.931114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:22.933080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 68/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:22.938990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:22.960112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca5f-9aa3-4947-a049-da97c00cda6b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:22.980721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:23.002717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:23.003898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.004456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.004972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] PATH_INFO: `/v3/projects/f5d2d2d7be2c49f09999af2879b4d251` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.014197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d2d2d7be2c49f09999af2879b4d251)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:23.016023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:23.018175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 67/135] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:22 2022] GET /identity/v3/projects/f5d2d2d7be2c49f09999af2879b4d251 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:23.025256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:23.140200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c719-d9d4-4442-aa8a-ec1c31e645e3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:23.155847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597769-46de-4ca9-af2f-0811b681ebbc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:23.169283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:23.181339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:23.190433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.190433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.190433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] PATH_INFO: `/v3/projects/f5d2d2d7be2c49f09999af2879b4d251/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.190433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d2d2d7be2c49f09999af2879b4d251, user_id=7ead7d199ae44c578a5f8d7af3148e8d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:23.190433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce97f-6c1c-4a99-bb0b-2add22ff77d2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:23.194560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:23.196128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.196391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.196692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/c80e1d4e886445cc85f651f6ae073c71/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.198846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, user_id=c80e1d4e886445cc85f651f6ae073c71, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:23.200326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:23.264319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 68/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:23 2022] PUT /identity/v3/projects/f5d2d2d7be2c49f09999af2879b4d251/users/7ead7d199ae44c578a5f8d7af3148e8d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:23.266100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0127e-7c61-4535-9745-d49d9fb29a41 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.266630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0127e-7c61-4535-9745-d49d9fb29a41 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.267115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0127e-7c61-4535-9745-d49d9fb29a41 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.269040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 69/137] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:23.275095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794973-b05a-4edb-9837-928e35e06894 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.275409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794973-b05a-4edb-9837-928e35e06894 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.275677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794973-b05a-4edb-9837-928e35e06894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.296879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:22 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/c80e1d4e886445cc85f651f6ae073c71/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:23.309145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-94794973-b05a-4edb-9837-928e35e06894 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:23.310395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-94794973-b05a-4edb-9837-928e35e06894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:23.371953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:23.409163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:23.454331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:23.602343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd22a16-9160-4156-ba67-e01b8aaf4d50 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:23.650732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:23.651548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.651840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.652123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.653380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:23.654852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4cc1-25e2-4362-aa36-41d6927479af None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:23.656779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 70/140] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:23.662257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794973-b05a-4edb-9837-928e35e06894 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:23.796576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794973-b05a-4edb-9837-928e35e06894 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:23.841745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:23.842435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:23.842727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:23.843008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:23.843741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:23.845251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b008c5-55ad-4e92-95fa-e9e9eca076d1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:23.971159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 71/141] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:23 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:24.154116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8d34-be70-434e-92c7-e6762541fdf5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:24.154624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8d34-be70-434e-92c7-e6762541fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:24.154739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8d34-be70-434e-92c7-e6762541fdf5 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:24.156397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 71/142] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:24.161944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:24.162244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:24.162533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:24.186542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:24.187774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:24.220757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:24.279746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:24.315796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae8d34-be70-434e-92c7-e6762541fdf5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:24.366630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:24.431579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae8d34-be70-434e-92c7-e6762541fdf5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:24.468714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:24.469518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:24.469871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:24.470156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:24.489011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:24.497304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:24.498134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:24.498905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 72/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:24.504543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:24.628371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bccd7c-f056-497f-90c7-5c35f027d055 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:24.672376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:24.673092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:24.673380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:24.673658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:24.674423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:24.674734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:24.676214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:24.685484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 73/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:24.690682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:24.833267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:24.838490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29415b-a1cb-44bd-97e9-296697c6d545 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:24.880401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:24.881284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:24.881574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:24.881856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:24.883686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:24.885197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:24.887222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 73/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:24 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:24.892320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:24.933053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:25.047570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219bb5-1beb-4f04-8bd2-0f8c880cd91c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:25.090918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:25.091923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.092414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.092974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.188724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:25.190635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce67aa-7345-4e1f-9855-f3a302c808e7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:25.216587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:25.314953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 74/147] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:25.321724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:25.469199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfccc-cd86-4445-afb0-0e27970cf0c3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.469514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfccc-cd86-4445-afb0-0e27970cf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.469783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfccc-cd86-4445-afb0-0e27970cf0c3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.470213 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3459ec-d2ba-4929-8d90-26ff9575ac64 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:25.471175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 75/148] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:25.482238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.482785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.483078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.512225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:25.522401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:25.522677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:25.524554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.524964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.525253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.529448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:25.530979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:25.532755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 74/149] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:25 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:25.538768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:25.601107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:25.619936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:25.658550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:25.688064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db365ee-e740-4969-8767-7ab81b10a077 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:25.744004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:25.765430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:25.766128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.766422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.766710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.767577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:25.767900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:25.772709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:25.776594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:25 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:25.817427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4b0c-4e99-476b-8576-04b0cd022f8a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:25.870211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:25.871331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:25.871773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:25.872202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:25.888240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:25.896937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:25.898718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:25.899684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:25.901880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:25.907861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:26.033131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:26.039603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066976-2fa7-4824-bea7-e57edbcf38a8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:26.086432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:26.087146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.087440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.087726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.088507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:26.088850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:26.091902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:26.101900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:26.109075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:26.271248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4cfb-e0b7-4c0d-be4a-bbf3d72bea64 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:26.289197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:26.310763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:26.311663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.311952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.312231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.317512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:26.318914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088373-8b6a-4fbf-a1aa-365257477109 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:26.321847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 78/154] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:26 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:26.327459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:26.472386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f671-25b4-4fb5-8cfd-82738cdf61b3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:26.513549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:26.514224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.514517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.514801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.548443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:26.587593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c175-bc0b-431f-a08d-fc75df74513f None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.587910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c175-bc0b-431f-a08d-fc75df74513f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.588160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c175-bc0b-431f-a08d-fc75df74513f None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.593938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 79/155] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:26.598692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:26.600206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:26.602647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.602944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.603237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.641734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:26.642959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:26.740632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 77/156] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:26.748700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:26.826390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:26.834069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 80/157] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:26.869199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:26.876638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799faf-5098-4bc7-b185-bcdf2cf6f159 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:26.926758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:26.927658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:26.927937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:26.928215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:26.933433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:26.934924 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:26.936697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 78/158] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:26 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:26.957717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.057621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f48cd-5a42-4632-8ab2-79b105b406fc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.079733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:27.104067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfab2e7-adc4-4b37-8517-a671c6421622 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.126100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.126922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.127206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.127486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.131921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:27.150749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.151419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.151700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.151974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.152825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:27.152949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:27.153161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:27.154618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ca7d-983b-4e78-9f22-61852f82bcae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:27.164338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:27.165338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:27.166178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 81/159] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:27.167522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 79/160] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:26 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:27.173356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.199267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c98ff-aac1-421a-a160-2e3a77500d98 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.199591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c98ff-aac1-421a-a160-2e3a77500d98 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.199826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c98ff-aac1-421a-a160-2e3a77500d98 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.204776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 80/161] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:27.214533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.214833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.215091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.245683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:27.246904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:27.355854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 81/162] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:27.391053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73da00-17e7-4dfe-99cb-db163241ad21 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.391670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.447239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.447929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.448212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.448488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.449290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:27.449600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:27.451024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d78cf-05dd-4d85-a33f-7cb821db0b52 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:27.469997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 82/163] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:27.471367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b05b-71e6-4251-ac37-c8611c970d6f None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.471658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b05b-71e6-4251-ac37-c8611c970d6f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.471935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b05b-71e6-4251-ac37-c8611c970d6f None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.474585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 83/164] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:27.481038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.481327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.481599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.517770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:27.518996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:27.566423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:27.580128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0bcec-4b78-4d9a-b715-fe9c3ec1e21b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.627619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:27.637096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 84/165] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:27.637954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.664959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.666148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.666755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.667230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.685193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:27.694040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:27.694969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:27.695728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:27.698220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 82/166] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:27.699234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.764943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03712b1-5887-49aa-bda5-48af61febb5e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.805637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.806529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.806811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.807084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] PATH_INFO: `/v3/users/ed01991703794241b6d21f1ec4b11bb5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.808996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] RBAC: Authorizing `identity:get_user(user_id=ed01991703794241b6d21f1ec4b11bb5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:27.810724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:27.812638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 85/167] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/users/ed01991703794241b6d21f1ec4b11bb5 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:27.814322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:27.855222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:27.883947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0baca-f4d0-426d-b1d4-1fc67097ea3a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.940109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb634-d89b-47b1-a845-e072e9abe9ce None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:27.972589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.973785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.974301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.974777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.978917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:27.979600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:27.979883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:27.980156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:27.980951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:27.981248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:27.983202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:27.993375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 86/168] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:27.994184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.006707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:28.033947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:28.034849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:28.035614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 83/169] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:28.036328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.091096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.097690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.107244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3147-c98e-42d1-9a42-da34000109a2 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.149880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.150679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.150961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.151237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.152457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.153967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86205e1c-72ac-44c2-b743-52c432f8986d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.155971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 87/170] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:27 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:28.157297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d001-9c53-4cda-8115-9c8a56c30f1b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.157587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d001-9c53-4cda-8115-9c8a56c30f1b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.157865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d001-9c53-4cda-8115-9c8a56c30f1b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.159091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 88/171] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:28.159793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d001-9c53-4cda-8115-9c8a56c30f1b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.174416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3b69-f75d-4918-86c7-fedc159f4603 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.209274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.210745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.211035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.211313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] PATH_INFO: `/v3/users/c80e1d4e886445cc85f651f6ae073c71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.212546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=c80e1d4e886445cc85f651f6ae073c71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.214162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.215788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 84/172] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/users/c80e1d4e886445cc85f651f6ae073c71 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:28.216586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.289911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d001-9c53-4cda-8115-9c8a56c30f1b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.327083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.327872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.328165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.328439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.329242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:28.329549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.330948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239719e-7611-4fd2-8ebb-a44b4e60b786 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.331808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc153c8-f7fa-4e02-97f2-c7f155da0ba5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.340871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 89/173] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:28.342209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.342498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.342775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.344867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.361574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:28.362990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:28.371224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.372418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.372847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.373242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/ed01991703794241b6d21f1ec4b11bb5/roles/6b7436af028945c885cc804dfdcb3587` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.375722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, user_id=ed01991703794241b6d21f1ec4b11bb5, role_id=6b7436af028945c885cc804dfdcb3587)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.377574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.382896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.435207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 90/174] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:28.436318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 85/175] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:28 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/users/ed01991703794241b6d21f1ec4b11bb5/roles/6b7436af028945c885cc804dfdcb3587 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:28.441964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.442147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.573806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355f93-3823-484d-aa0e-00cd9d38743f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.628255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.629191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.629476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.629753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] PATH_INFO: `/v3/users/7ead7d199ae44c578a5f8d7af3148e8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.631358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ead7d199ae44c578a5f8d7af3148e8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.633410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.635456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 86/176] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/users/7ead7d199ae44c578a5f8d7af3148e8d => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:28.635950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.643282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9db0d-092c-4d9e-86da-855375cc0d9f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.688085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.689538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.690211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.690495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.690769 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.714364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.766770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90b3b-5151-476e-8adb-394b5ae6dfd4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:28.772455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:28.774518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:28.803832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:28.805393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.805683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.806072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.817442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-8e763455-b071-4f66-ae97-f0ade152934d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:28.826518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:28.827406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:28.828178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:28.828794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 87/177] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:28.829724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc8d2-11a0-4803-9f64-d3d7f25117cc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:28.830021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc8d2-11a0-4803-9f64-d3d7f25117cc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:28.830302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc8d2-11a0-4803-9f64-d3d7f25117cc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:28.831592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 88/178] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:28.832478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc8d2-11a0-4803-9f64-d3d7f25117cc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.893047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 91/179] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:28.893995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:28.962326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.963451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:28.968903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc8d2-11a0-4803-9f64-d3d7f25117cc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.013394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.013786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24657-2721-4a39-a3fc-8309248cd238 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.014124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.014415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.014692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.049543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.050276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.050510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.050793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.051557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:29.051872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.053367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73689-a943-4519-bab5-77e846c0cc04 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.066161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 92/180] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.066161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.066161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.066161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.080080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:29.081306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:29.101495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.103536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04beed-77d5-4d23-b742-a19006cdcf9a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.151985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:29.157565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.207615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.213418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 89/182] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:29.217875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.218986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f9f2-c62b-4c05-84d6-31b19843a46a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.219182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f9f2-c62b-4c05-84d6-31b19843a46a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.219462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f9f2-c62b-4c05-84d6-31b19843a46a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.220972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 90/183] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:29.225428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f9f2-c62b-4c05-84d6-31b19843a46a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.277338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51667bf-8e57-4132-acb5-32fce5ea58be None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.315947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.316959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.317316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.317669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.318872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.320888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.327318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 94/184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.328086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.337251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f9f2-c62b-4c05-84d6-31b19843a46a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.377916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.378800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.379089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.379362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.393840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.395306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.397042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 91/185] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.402796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.435775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f835e5-27d3-49c6-ab26-6e794e77c4a2 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.449751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.462207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.470440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.471189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.471475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.471755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.473409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.474867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b2a52-5081-4ae0-8491-073636f3b46f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.477275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 95/186] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.478393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.478686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.478997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.495973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:29.498010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:29.513374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b8abb-4728-4d6c-aaf5-cc09218dadc7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.548838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.549719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.550006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.550307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] PATH_INFO: `/v3/projects/f5d2d2d7be2c49f09999af2879b4d251` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.551489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] RBAC: Authorizing `identity:get_project(project_id=f5d2d2d7be2c49f09999af2879b4d251)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.552995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.560507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 92/187] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/projects/f5d2d2d7be2c49f09999af2879b4d251 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.560507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.576448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 96/188] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:29.577545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.678185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6e45-f648-432e-b4f7-3c18bedd4c0c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.686173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0946f6-3e37-40b1-b732-132908b56083 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.698796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.705059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:29.715707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.716448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.716770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.717130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.717895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=c80e1d4e886445cc85f651f6ae073c71) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:29.718207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.719669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.725701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 93/189] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/role_assignments?user.id=c80e1d4e886445cc85f651f6ae073c71&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:29.726758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.739491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.741151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.743679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.743679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.840506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.842918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.854408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a8f0e-6127-4f3f-86b5-f4ac3438aeb1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:29.897392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:29.899163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:29.899451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:29.899730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:29.900451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:29.902642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:29.958601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 97/190] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:29.959546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:29.972191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.030403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 94/191] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:29 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:30.041808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.080693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515325-90b1-4041-893d-af9074c2f411 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.098873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.134028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.135089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.135591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.136044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.137128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=f5d2d2d7be2c49f09999af2879b4d251, user.id=7ead7d199ae44c578a5f8d7af3148e8d) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:30.138213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:30.139940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:30.152887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:29 2022] GET /identity/v3/role_assignments?user.id=7ead7d199ae44c578a5f8d7af3148e8d&scope.project.id=f5d2d2d7be2c49f09999af2879b4d251&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:30.155849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.192071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdb9c1-8d76-4135-a7c0-ba0a115319a3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.242102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.242962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.243353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.243518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.258248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:30.266828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:30.268001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:30.269057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 95/193] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:30.276501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.285608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.323586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed869-853b-4095-858c-e12b32755530 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.371409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.372929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.373142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.373426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.375818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:30.377878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:30.380258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:30.385864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.406687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88ae9-8784-4318-aa2f-5fff9d28c9e4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.411482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.459575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.460757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.461233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.461663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.462599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:30.462916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:30.464324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:30.477284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 96/195] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:30.483851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.528806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab4ea-0098-4df2-a97a-afd13c663b4c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.578398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.579076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.579361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.579646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.580592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=17067b5ed5df49cdb447bb1af7643cae) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:30.580947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:30.582399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b58c5-b8fe-4ff6-a968-d1c7d0eb5f6f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:30.588991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 100/196] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/role_assignments?user.id=17067b5ed5df49cdb447bb1af7643cae&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:30.627106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff108c-683b-45cc-bd6d-0c9541f5cee1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.659021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6c7-d51a-480d-8025-fd52163004e5 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.659365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6c7-d51a-480d-8025-fd52163004e5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.659597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6c7-d51a-480d-8025-fd52163004e5 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.661074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 101/197] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:30.667895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.668196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.668467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.673265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.674974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.676534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.677096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.678720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:30.680623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:30.682709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.684390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 97/198] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:30.690702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.694051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:30.696470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:30.744776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:30.812352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:30.819418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f6b4c-6ec4-4fec-bba0-34d6907a8334 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:30.838140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:30.868929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:30.869612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:30.869897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:30.870178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:30.974830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada38186-971d-4356-a2f4-44bcf94548e3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.032706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.032706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.034913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.035339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.035622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.035895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.038909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:31.047742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:31.056473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:31.057394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:31.058166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 103/200] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:31.063543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:31.107339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:31.171182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96ef-1f37-49f6-bcd7-b301cf7ce58c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.208564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.209294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.209574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.211030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.211274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:31.211585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.213006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.222166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 104/201] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:31.227682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:31.293040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:31.309125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:38:31.314960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:31.392900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1855-2af5-4ff1-a8a0-da82938192c0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.471908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.472962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.473324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.473612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] PATH_INFO: `/v3/users/ed01991703794241b6d21f1ec4b11bb5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.479168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] RBAC: Authorizing `identity:get_user(user_id=ed01991703794241b6d21f1ec4b11bb5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.480810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.483180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 105/203] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/users/ed01991703794241b6d21f1ec4b11bb5 => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:31.503772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:31.536627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d6eb-d598-4ef8-b2b8-a7e1e440fc03 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.613258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.614102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.614388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.614687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.616193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.624388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.624388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 99/204] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:31.625452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:31.633010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:31.693763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406adc2-7b59-4186-8fa9-ff3c931ec4fe None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.746352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:31.763203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.763871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.764155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.764431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.816057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a843f-3bd3-49e2-9f03-3d94e95798af None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:31.850299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.853283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.878398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:31.879003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:31.879291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:31.879572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:31.880423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=17067b5ed5df49cdb447bb1af7643cae) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:31.880839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:31.882445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:31.902838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/role_assignments?user.id=17067b5ed5df49cdb447bb1af7643cae&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:31.972080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 106/206] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:38:31.977482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:32.080439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:32.132096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa9bd-bf0e-465c-9277-3ebb02959aa4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:32.178905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:32.179808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.180247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.180531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.181817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:32.183281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731159-ad7e-4365-9bb5-13e361f05335 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:32.185343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:31 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:32.191176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:32.220896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:32.302873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c8b8e-70e8-4a90-8b33-253f8696a8f5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:32.349391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:32.350088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.350379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.351203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.352072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, scope.project.id=2384e30be7ae459b90db0724dfdb7b49, user.id=ed01991703794241b6d21f1ec4b11bb5) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:32.352392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:32.353882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141cf2d-8ae5-4358-ace5-b2f9723708fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:32.360724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:32 2022] GET /identity/v3/role_assignments?user.id=ed01991703794241b6d21f1ec4b11bb5&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=6b7436af028945c885cc804dfdcb3587 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:32.735318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c3c3c-cf07-4bab-ac47-d7515d050cfa None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.735826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c3c3c-cf07-4bab-ac47-d7515d050cfa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.735930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c3c3c-cf07-4bab-ac47-d7515d050cfa None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.737297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:32.743202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.743761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.744243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.767257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:32.768826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:32.833855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5332a-7f3c-46a3-8557-83bdcf373f75 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.834154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5332a-7f3c-46a3-8557-83bdcf373f75 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.834419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5332a-7f3c-46a3-8557-83bdcf373f75 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.836367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 103/210] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:32.841596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:32.841886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:32.842170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:32.861878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:32.863089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:32.863802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:32.888871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:32.914276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:32.937200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:32.962174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.020274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7753a2-15e4-420e-bbe9-2e0b508bd8a9 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.035645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.060402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.061254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.061541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.061819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.073830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:33.075228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9851-b359-4d12-824e-b68aa58073e1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-0bec2c40-9c98-456b-9efa-1e6a5c70e4d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:33.081550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:33.082422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:33.083967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 109/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:33.088841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311901-fb3f-4ac8-9345-5044eada11cd None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.089130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311901-fb3f-4ac8-9345-5044eada11cd None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.089430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311901-fb3f-4ac8-9345-5044eada11cd None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.090887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 110/214] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:33.091371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311901-fb3f-4ac8-9345-5044eada11cd None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.115965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.117413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.117699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.117976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.119151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.120623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc91947-e8a5-430c-8c71-1848f531df71 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.122275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 105/215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:33.125915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.126545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.128031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.144692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:33.145921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:33.190569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.210325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311901-fb3f-4ac8-9345-5044eada11cd None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.228706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 106/216] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:33.228706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.253907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.254623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.254880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.255159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.255923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:33.256232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.257998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.266943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 111/217] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:33.269586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.296971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.339337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abed85-9773-48fa-933b-d30f81101203 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.375911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.376647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.376978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.377254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.378028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.379489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.382301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30c63-eb16-42d1-87b0-2c7786bb4d3b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.418898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.419801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.420151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.420495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.432927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:33.440937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:33.441955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 112/218] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:33.442928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.448699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.468657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 107/219] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:33 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:33.469531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.559968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf2f4-6a12-4ce6-afa2-1a2d933246fc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.600333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.603751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.603918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.604459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] PATH_INFO: `/v3/users/601281d5df9545a4a9fed3a168d7b68b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.620843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b962-daf4-4607-87cf-6ce84bf8412a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.621160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] RBAC: Authorizing `identity:get_user(user_id=601281d5df9545a4a9fed3a168d7b68b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.623450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.628934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 113/220] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/users/601281d5df9545a4a9fed3a168d7b68b => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:33.631192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.646077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.665200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.665889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.666178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.666521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.667295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:33.667606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.670674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.678755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 108/221] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:33.685800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.704298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.760954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff3be7-fddd-4c39-844a-aea3b701edb0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.813017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.813938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.814375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.814817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.830200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d66ee1-0d63-46f3-99a0-81287a2a1185 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:33.875657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:33.876852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:33.877932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:33.878393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:33.880385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.883052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.885678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 109/222] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:33.891558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:33.898784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:33.900581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:33.950212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:33.973813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:34.038810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 114/223] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:34.044487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:34.062672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b8e2-b36f-49f7-b4cf-14a12cb965c3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.158428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.159230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.159519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.159798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.161845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7937062-7caf-42c1-bafd-d3c56c4e33d5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.165484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:34.166998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:34.168830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 110/224] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:33 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:34.174562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:34.204052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.205311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.205806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.206294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.207730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:34.209592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:34.212391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 115/225] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:34 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:34.219639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:34.253731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:34.344505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361945a-9908-471e-bf1b-5b150d54661a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.385721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.386749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.387252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.387734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.389230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=601281d5df9545a4a9fed3a168d7b68b) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:34.389759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:34.391422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a2ce-fc45-4c78-8b3b-efabe9a950d6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:34.398400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 116/226] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:34 2022] GET /identity/v3/role_assignments?user.id=601281d5df9545a4a9fed3a168d7b68b&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:34.403649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b46a1-dd79-45a2-85ae-6abb8e221d4a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.437151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:34.452656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce98f-825f-4799-bca3-3a281b9707d2 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.453625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce98f-825f-4799-bca3-3a281b9707d2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.454406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce98f-825f-4799-bca3-3a281b9707d2 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.456946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 117/227] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:34.463408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.464218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.464828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.465313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.466232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.466517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.466794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/17067b5ed5df49cdb447bb1af7643cae/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.472799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, user_id=17067b5ed5df49cdb447bb1af7643cae, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:34.472799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:34.492180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:34.493843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:34.562114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 111/228] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:34 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/17067b5ed5df49cdb447bb1af7643cae/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:38:34.577442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 118/229] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:34.606649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:34.723181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf589-9913-4cec-b4b9-b2ea016752d0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.760312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.761176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.761455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.761726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.772295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:34.781971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:34.782844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:34.783640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 112/230] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:34.791258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:34.823017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:34.907125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7aa7-8c6c-4443-be01-d4e95d7e7275 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:34.943671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:34.944922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:34.945229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:34.945509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:34.946287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:34.946601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:34.948011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:34.956959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 119/231] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:34.962763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:35.012226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:35.108355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138051e-af3f-4574-aebf-211608911dd9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:35.158844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:35.160118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:35.160601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:35.161119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:35.165396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:35.167080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:35.169274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 113/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:34 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:35.174702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:35.305485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:35.318438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a669f-36d4-4b27-9716-973ea192dac8 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:35.362607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:35.363499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:35.363788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:35.364072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:35.365323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:35.367348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d320-0e6b-4505-bf60-df00203fa455 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:35.369474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 120/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:35 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:35.374724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:35.525975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111af2-5373-4c55-becb-9d80e3a27844 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:35.528979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:35.576242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:35.577150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:35.577433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:35.577748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/17067b5ed5df49cdb447bb1af7643cae/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:35.580044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, user_id=17067b5ed5df49cdb447bb1af7643cae, role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:35.581528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392a7c3-756d-4f00-b5d3-826cbf499dbb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:35.690341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:35 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/17067b5ed5df49cdb447bb1af7643cae/roles/26cba7b0722e440abff4c508da7eb0bb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:36.102788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee269-a6fc-4171-bb66-6723dabfd9f1 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.103463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee269-a6fc-4171-bb66-6723dabfd9f1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.103960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee269-a6fc-4171-bb66-6723dabfd9f1 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.105872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 121/235] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:36.111375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ed5-4c54-4011-89a2-bf6d8ce3f547 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.112237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ed5-4c54-4011-89a2-bf6d8ce3f547 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.112773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ed5-4c54-4011-89a2-bf6d8ce3f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.133742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fdd28ed5-4c54-4011-89a2-bf6d8ce3f547 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:36.135330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fdd28ed5-4c54-4011-89a2-bf6d8ce3f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:36.228118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:36.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445857-f1f6-45d6-826b-cf4073191aab None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.240829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445857-f1f6-45d6-826b-cf4073191aab None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.241942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445857-f1f6-45d6-826b-cf4073191aab None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.243537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 122/237] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:36.249027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.249321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.249599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.273974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:36.275097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:36.284114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16445857-f1f6-45d6-826b-cf4073191aab None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:36.382728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:36.450308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16445857-f1f6-45d6-826b-cf4073191aab None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:36.460710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:36.496705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:36.529155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:36.529155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.529155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.529155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.547687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:36.566630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:36.567596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:36.568390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 123/239] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:36.575235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:36.605438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:36.645013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d8373-6d79-467a-9fb0-12bda27ead8e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:36.712534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:36.713376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.713656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.713930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.715258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:36.716753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:36.718406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:36.729495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:36.780089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd745-1b1e-4c24-ad96-1e11f1634916 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:36.822549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:36.823231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.823514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.823791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.824548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:36.824885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:36.826899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:36.836641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 124/241] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:36.845628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:36.878098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:36.888283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2293-084f-414b-a3a8-ca8aa5f45293 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:36.932580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:36.933312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:36.933892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:36.934177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:36.935356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:36.937137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492010-908b-41e5-9e92-3cb0689b0493 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:36.949377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:36.973601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cbf16-3e80-487f-8ee9-91f1e0192871 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.008334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.011797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.011797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.011797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] PATH_INFO: `/v3/users/ab3c2025ef67494dabd69abac416c667` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.030537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] RBAC: Authorizing `identity:get_user(user_id=ab3c2025ef67494dabd69abac416c667)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:37.032041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d9200-7c15-4707-9ef3-6d631aba3c80 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:37.034017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 125/242] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:36 2022] GET /identity/v3/users/ab3c2025ef67494dabd69abac416c667 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:37.040749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456a45-bd7d-4604-b128-e8f0a0151c7a None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.040749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456a45-bd7d-4604-b128-e8f0a0151c7a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.040749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456a45-bd7d-4604-b128-e8f0a0151c7a None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.040749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 126/243] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:37.042520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0456a45-bd7d-4604-b128-e8f0a0151c7a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.053637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 118/244] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:36 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:37.060799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949e49-fa2c-421e-bebf-88eb5eed3645 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.061678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949e49-fa2c-421e-bebf-88eb5eed3645 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.062210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949e49-fa2c-421e-bebf-88eb5eed3645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.098091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b3949e49-fa2c-421e-bebf-88eb5eed3645 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:37.099920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3949e49-fa2c-421e-bebf-88eb5eed3645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:37.158932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0456a45-bd7d-4604-b128-e8f0a0151c7a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.200804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.206561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.207296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.207584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.207863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.209319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 119/245] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:37.215321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abee74-117a-4a1b-bd8b-55a2b08f1bd1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.215321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abee74-117a-4a1b-bd8b-55a2b08f1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.215321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abee74-117a-4a1b-bd8b-55a2b08f1bd1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.217566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 120/246] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:37.232442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.233019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.233306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.254965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:37.256216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:37.318562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:37.321339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:37.345053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 121/247] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:37.345053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.362321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.443128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 127/248] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:37.443826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.485769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e201ce-c818-4066-be88-fd2ab5667e79 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.492190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.529195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.530843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.531311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.531788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.547560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:37.559264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:37.560183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:37.561094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 122/249] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:37.562266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.578477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd44df-7258-4f2e-8c95-006ba0a98b8f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.625200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.625987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.626273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.626547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.641992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.646797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:37.655756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:37.665486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 128/250] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:37.666281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.684290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15cfb-6a13-4fc3-9c3d-a69dd9586f6a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.746052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.746933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.747212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.747484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.749648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:37.751114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:37.752926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 123/251] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:37.753689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.816323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.828717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7b44-4dd5-431d-b5b6-3cd181da6321 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.902358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.903056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.903342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.903616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.904175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b04dc-569a-4273-8fcd-ff14847f3b69 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:37.904378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:37.904701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:37.906113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:37.924753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 129/252] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:37.925627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:37.941388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:37.942407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:37.942903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:37.943410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:37.944981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:37.945589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:37.947225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:37.952976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:37.957943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 124/253] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:37.958871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.066682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a56-c5f2-48fe-ac8f-9772031aa3a2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.105229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.106200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.106597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.107006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] PATH_INFO: `/v3/users/601281d5df9545a4a9fed3a168d7b68b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.108618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] RBAC: Authorizing `identity:get_user(user_id=601281d5df9545a4a9fed3a168d7b68b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.110242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:38.112231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 125/254] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/users/601281d5df9545a4a9fed3a168d7b68b => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:38.112939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.139949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982258-209a-4bf9-8d1d-e110fd3e2dff None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.193083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:38.205449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.206271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.207850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.208047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.208945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=ab3c2025ef67494dabd69abac416c667) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:38.210857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.212545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:38.221486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 130/255] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:37 2022] GET /identity/v3/role_assignments?user.id=ab3c2025ef67494dabd69abac416c667&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=6b7436af028945c885cc804dfdcb3587 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:38.222387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.237038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6731c5-6aa8-4565-8d48-1cc7d249ecb7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.267833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:38.283443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.284351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.284660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.284958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.286295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.287789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a043a1a-27b4-4933-8dfa-54b2fde660ac None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:38.290209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 126/256] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:38 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:38.291594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006ce9e-0145-434e-839f-520fbe9a1512 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.291890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006ce9e-0145-434e-839f-520fbe9a1512 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.292180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006ce9e-0145-434e-839f-520fbe9a1512 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.297032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 127/257] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:38.297032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006ce9e-0145-434e-839f-520fbe9a1512 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.434594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd461-6650-4732-94a9-0f30db7df04a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.449136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006ce9e-0145-434e-839f-520fbe9a1512 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.484200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.486074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.486708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.487299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.488855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.489753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.490474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.490763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.491080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.491830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107484-60c2-48b0-b4bc-3036795ebbaa None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:38.493827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 131/258] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:38 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:38.494445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:38.496163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.497602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.498101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.525806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:38.527407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:38.620005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.621895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:38.679879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 132/259] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:38.685130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.731824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:38.761882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 128/260] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:38.765946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:38.832988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:38.898551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d79cbf-30c1-4ca5-9992-0b4d257a5f7a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.947634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029fd8-451e-4a45-945d-9421c33d3a74 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:38.970114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:38.971025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:38.971310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:38.971583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/601281d5df9545a4a9fed3a168d7b68b/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:38.975092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, user_id=601281d5df9545a4a9fed3a168d7b68b, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:38.978087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.001386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.002261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.003294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.003294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.017112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:39.025863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:39.026728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 129/261] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:39.028641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:39.079303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 133/262] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:38 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/601281d5df9545a4a9fed3a168d7b68b/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:39.080165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:39.143216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:39.151276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496e43-18a0-4718-93e7-3cdd87163115 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:39.196759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.197736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.197960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.198245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.205684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:39.207209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.209522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:39.215314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:39.285085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:39.319592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d5a60-bbc6-429c-abeb-5ba2590784e3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:39.331986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b98d6-23e2-4fc7-afb5-6e8f5b6987df None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:39.374287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.374980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.375269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.375548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.376312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:39.376623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:39.376991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.377760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.378053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.378229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.378625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.379576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=17067b5ed5df49cdb447bb1af7643cae) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:39.379962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:39.381511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.391610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 134/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:39.393449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 131/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/role_assignments?user.id=17067b5ed5df49cdb447bb1af7643cae&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:39.397711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:39.557260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4851-1d2b-4608-8213-c07e2ae5a2fb None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:39.603732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.604632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.604942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.605224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] PATH_INFO: `/v3/users/17067b5ed5df49cdb447bb1af7643cae` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.607278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] RBAC: Authorizing `identity:get_user(user_id=17067b5ed5df49cdb447bb1af7643cae)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:39.609084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86671cce-44bf-4ff9-906f-48391eed4365 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.610752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 135/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/users/17067b5ed5df49cdb447bb1af7643cae => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:39.617120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:39.664212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:39.749008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ba66-54f7-46d9-9c36-9c8faa7596e7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:39.786556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:39.787231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.787524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.787807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.852536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec60-8c99-4a1e-828f-bffbe917e3d3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.853164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec60-8c99-4a1e-828f-bffbe917e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.853645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec60-8c99-4a1e-828f-bffbe917e3d3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.859470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:39.859756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 136/267] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:39.860972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:39.862907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:39.863395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:39.863868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:39.879519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:39.887707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:39.889080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:39.889387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:39.970747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 132/268] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:39.977064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.012701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 137/269] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:40.081420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.146228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dd03c-79e2-4e90-b036-46cf35f6407d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.198169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.216521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.217778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.218260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.218915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.221691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.224077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.226744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 133/270] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:39 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:40.237635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.239836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2043ef5-648c-4ec3-be6f-953390fc49d7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.276707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.277258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.277621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.277812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.283317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.289971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-372a5836-419e-494f-813f-03c3095d1810 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:40.298057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:40.298970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:40.299772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 138/271] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:40.301009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8dd3-78ab-4480-be33-ca42b07efa11 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.301295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8dd3-78ab-4480-be33-ca42b07efa11 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.301570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8dd3-78ab-4480-be33-ca42b07efa11 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.307463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 139/272] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:40.308458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8dd3-78ab-4480-be33-ca42b07efa11 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.393820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba765a0-46cd-4ebf-8596-1aeb6afdf569 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.432967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8dd3-78ab-4480-be33-ca42b07efa11 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.440274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.441430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.441719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.441999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.442842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=17067b5ed5df49cdb447bb1af7643cae) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:40.443155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.445802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cb0d-b85b-4c0f-8d6f-aa93f3b884da None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.456974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 134/273] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/role_assignments?user.id=17067b5ed5df49cdb447bb1af7643cae&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:40.458420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.458951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.459057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.487396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.488337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:40.488756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.489315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.489788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.489901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:40.490867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:40.491919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.493769 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.514982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 140/274] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:40.520534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.554351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.574112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 135/275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:40.611367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.628280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.721110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea70c0-b91a-452c-96d5-c81a9163c4c8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.726651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86595-b71b-4311-8552-464e00ccd129 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.761665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.762478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.762762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.763041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.764488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.766506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.768600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 136/276] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:40.771516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.772785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.773363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.773782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] PATH_INFO: `/v3/users/9b20a96bc4854473a2e848be157578de` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.774579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.790796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] RBAC: Authorizing `identity:get_user(user_id=9b20a96bc4854473a2e848be157578de)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.792572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99564c8a-1c81-4e02-9aa6-77de06c0e850 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.795540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 141/277] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/users/9b20a96bc4854473a2e848be157578de => generated 293 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:40.797079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4b4-0141-4ab4-8c0d-844284f73cd3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.797515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4b4-0141-4ab4-8c0d-844284f73cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.797933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4b4-0141-4ab4-8c0d-844284f73cd3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.799706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 142/278] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:40.801198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd4b4-0141-4ab4-8c0d-844284f73cd3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:40.859587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.915293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bdd6-07d5-4aad-8eee-b16acc534783 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.930184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd4b4-0141-4ab4-8c0d-844284f73cd3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:40.948031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:40.956119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.956837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.957126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.957398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.958135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.959571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.966240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:40.967023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.967307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.967589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.968517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, user.id=9b20a96bc4854473a2e848be157578de, scope.system=all) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:40.968866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:40.970309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c966b-8e0e-416a-992b-e4e17e04aa23 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:40.975324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 143/279] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 5 12:38:40 2022] GET /identity/v3/role_assignments?user.id=9b20a96bc4854473a2e848be157578de&scope.system=all&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:40.976886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:40.977483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:40.978201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:40.997278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:40.998589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:41.067697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 137/280] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:38:40 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:38:41.092829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:41.117914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:41.242662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a577-65be-4b8e-9f83-8df200f091ae None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:41.257671 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:41.278969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:41.280036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.280475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.280784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.294210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:41.302210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:41.307556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:41.308396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 138/282] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:41.311685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:41.430059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8cab2-dd21-4e6d-bc92-fb9744ec383f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:41.442719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:41.468752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:41.469709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.469997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.470277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.471065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:41.471399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:41.473137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:41.483484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 145/283] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:41.489040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:41.606396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4ef3c-21ae-4e69-9f90-23108c76e85b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:41.642082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:41.642975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.643308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.643586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] PATH_INFO: `/v3/users/ab3c2025ef67494dabd69abac416c667` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.644839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] RBAC: Authorizing `identity:get_user(user_id=ab3c2025ef67494dabd69abac416c667)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:41.646298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed4b3d-6ce1-41d1-8b79-bc31757ad98a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:41.649263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 139/284] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:41 2022] GET /identity/v3/users/ab3c2025ef67494dabd69abac416c667 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:41.655632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:41.749294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90ea9-0870-4d9d-9eb4-8ce006e482be None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.749580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90ea9-0870-4d9d-9eb4-8ce006e482be None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.749861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90ea9-0870-4d9d-9eb4-8ce006e482be None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.752836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 140/285] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:41.761049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.761345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.761619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.789722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:41.790962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:41.856912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:41.861331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6113-ff0e-4450-b28b-5f8ef00fff76 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:41.920980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 141/286] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:41.933711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:41.934917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:41.935418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:41.935891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:41.937365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:41.939043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:41.941021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 146/287] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:41 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:41.945359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:41.956847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:42.029777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:42.118315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35518-a952-48ff-96af-057a9d725162 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:42.168351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e63d54-492d-4bf0-afa0-ab06e3c9462b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:42.173107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:42.174123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:42.174417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:42.174731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/ab3c2025ef67494dabd69abac416c667/roles/6b7436af028945c885cc804dfdcb3587` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:42.176911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, user_id=ab3c2025ef67494dabd69abac416c667, role_id=6b7436af028945c885cc804dfdcb3587)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:42.179705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:42.210728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:42.211599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:42.211894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:42.212173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:42.223186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:42.232495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:42.233727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:42.234495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 142/288] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:42.242650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:42.250807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 147/289] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:38:41 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/users/ab3c2025ef67494dabd69abac416c667/roles/6b7436af028945c885cc804dfdcb3587 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:42.284953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:42.382332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3a8f-454e-41ec-a96c-c92e11b25623 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:42.435255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:42.435964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:42.436252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:42.436536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:42.437363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:42.437676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:42.439090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:42.455349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 143/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:42.461849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:42.580056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:42.583441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad561-182a-419e-9adb-3b95d05c4c5d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:42.623998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:42.625368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:42.625952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:42.626455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] PATH_INFO: `/v3/users/601281d5df9545a4a9fed3a168d7b68b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:42.628288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] RBAC: Authorizing `identity:get_user(user_id=601281d5df9545a4a9fed3a168d7b68b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:42.630878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:42.632833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 148/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:42 2022] GET /identity/v3/users/601281d5df9545a4a9fed3a168d7b68b => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:42.640728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:42.796325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:42.805318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5fd6-283e-4d48-b8e4-4e18b65c5554 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:42.853936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:42.854609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:42.854899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:42.855180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:42.940209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:42.941638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:43.072063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:43.081998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 144/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:43.088115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.233274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a68-fcea-40bb-b588-bfb009f52c66 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:43.281393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:43.282580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.283048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.283503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.284995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:43.286617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98f9a4-c15d-4841-82c5-e9de14e38178 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:43.289087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 149/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:43.295111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.368289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b6d4-c817-4f44-a112-38690b52fe38 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.368570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b6d4-c817-4f44-a112-38690b52fe38 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.369041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b6d4-c817-4f44-a112-38690b52fe38 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.370595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 150/294] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:43.375885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.376378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.376837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.395715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:43.398412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:43.437030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e56b5-9e5e-409b-a334-6926def7d4fa None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:43.458305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:43.474446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:43.475111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.475957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.476483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.477070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=601281d5df9545a4a9fed3a168d7b68b) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:43.477385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:43.478903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:43.485690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 145/295] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/role_assignments?user.id=601281d5df9545a4a9fed3a168d7b68b&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:43.519458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 151/296] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 12:38:43.548491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.613618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:43.661392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81ec0-77e7-439d-a514-d3ced2b101ff None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:43.700085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:43.701230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.701695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.702153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.713195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-583824ea-97a6-4d24-a3e3-87305678bc9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:43.721393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:43.722275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:43.723054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:43.725928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 146/297] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:43.732437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.794022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598049-abe0-4b93-9e8a-28aa62feb859 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.794225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598049-abe0-4b93-9e8a-28aa62feb859 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.794507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598049-abe0-4b93-9e8a-28aa62feb859 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.796028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 147/298] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:43.802336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.802615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.802888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.823246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:43.824506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:43.844547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7ec3-ca73-4856-9451-02b5dbea2fb4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:43.890072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:43.891292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:43.891727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:43.892313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:43.893573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:43.894327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:43.896041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:43.905410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 148/299] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:43.907535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 152/300] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:43.916037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.938199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:43.971526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:43.983842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.047725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f462d4b-142d-42fd-bc2a-e88177769c4c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.078619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b472afa-64ae-42cd-8027-ae0f41c9976a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.084179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.085683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.085962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.086234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] PATH_INFO: `/v3/users/9b20a96bc4854473a2e848be157578de` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.087491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] RBAC: Authorizing `identity:get_user(user_id=9b20a96bc4854473a2e848be157578de)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.088981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93660ba1-0317-4bfb-8329-880bad2ce1cf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.095009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 149/301] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/users/9b20a96bc4854473a2e848be157578de => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:44.095009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299037-0f14-495e-b687-f5738d40da07 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.095009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299037-0f14-495e-b687-f5738d40da07 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.095009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299037-0f14-495e-b687-f5738d40da07 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.095009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 150/302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:44.097445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68299037-0f14-495e-b687-f5738d40da07 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.120993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-66df828d-df4f-4e76-ab96-7459b2c8885a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:44.466044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:44.466791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:44.467770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.468863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.469546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:44.469546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:44.469698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68299037-0f14-495e-b687-f5738d40da07 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.469698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.469944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 154/304] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:44.469944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.469944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.470176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.470176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.470176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.470176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] PATH_INFO: `/v3/system/users/9b20a96bc4854473a2e848be157578de/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.470524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b20a96bc4854473a2e848be157578de, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.470524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.470693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825d8c8-1b3e-4832-98af-ba4f1b9a4741 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.470693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.470693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.470693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 155/305] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:44.470993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.494933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5617-b158-455a-9434-bd2675786b1c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.529187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.529991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.530274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.530550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.531425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 151/306] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 5 12:38:44 2022] PUT /identity/v3/system/users/9b20a96bc4854473a2e848be157578de/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:44.532412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.537290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.539729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.542634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 156/307] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:44.549097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.579243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.671378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049dbf-fce6-41a4-b531-d1983b0b688a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.685339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425c2a1-d867-4d74-aea9-9cf157cc7522 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.713276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.713968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.714951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.714951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] PATH_INFO: `/v3/groups` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.715224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.716823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a8cf4-4835-4524-970f-272a0e5b9ccc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.732303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.735764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.735764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.735764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] PATH_INFO: `/v3/users/9ecab7a9939f4a8887f6f20af200cefb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.749756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecab7a9939f4a8887f6f20af200cefb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.751232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.753278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 152/308] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:44 2022] GET /identity/v3/users/9ecab7a9939f4a8887f6f20af200cefb => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:44.759847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:44.786042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 157/309] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Jul 5 12:38:44 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:44.808209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.890422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936ac0f-3736-4381-bec1-e106a5b9c3b2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:44.895689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e445-ccde-4d31-9d50-275d3809cc5c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.895988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e445-ccde-4d31-9d50-275d3809cc5c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.896266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e445-ccde-4d31-9d50-275d3809cc5c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.897984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 158/310] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:44.903516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.903810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.904093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.923207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:44.924416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:44.929948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:44.945694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:44.947975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:44.947975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:44.947975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:44.948755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, user.id=9ecab7a9939f4a8887f6f20af200cefb, scope.system=all) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:44.949285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:44.951009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:44.957540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 153/311] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 5 12:38:44 2022] GET /identity/v3/role_assignments?user.id=9ecab7a9939f4a8887f6f20af200cefb&scope.system=all&role.id=6b7436af028945c885cc804dfdcb3587 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:45.014458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 159/312] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:45.041790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:45.154372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:45.157981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fa0c7-e332-45c8-ae5d-8f5b5e5185b4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:45.195879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:45.196768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:45.197053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:45.197329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:45.208093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:45.216610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:45.217557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:45.218750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 154/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:45.223996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:45.330628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411a0b-501e-41f2-beb3-4881550da11f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:45.367491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:45.368173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:45.368458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:45.368765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:45.369532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:45.369841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:45.371231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:45.376514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:45.380370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 160/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:45.386509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:45.495822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a026-77d6-4426-86e9-4f812d5dd072 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:45.531732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:45.532620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:45.532934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:45.533210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] PATH_INFO: `/v3/users/ab3c2025ef67494dabd69abac416c667` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:45.534411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] RBAC: Authorizing `identity:get_user(user_id=ab3c2025ef67494dabd69abac416c667)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:45.535877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:45.538393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 155/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:45 2022] GET /identity/v3/users/ab3c2025ef67494dabd69abac416c667 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:45.543822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:45.653494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59abec-f220-43c7-aaed-add4f300743b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:45.687687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:45.688357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:45.688643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:45.688946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:45.761192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:45.762997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:45.763516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:45.865296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 161/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:45.872238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:45.901761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:45.975750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6739-918d-4a45-96d7-f0b4264f7142 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:46.013044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:46.014229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.014667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.015112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.016545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:46.018297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7b025-33e5-4ca1-a8ab-d64fa4823d74 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:46.020512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 156/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:45 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:46.028809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:46.130174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:46.133827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29a5-aa5a-4e21-a686-a91215589138 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:46.172205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:46.172910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.173200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.173481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.174460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af, user.id=ab3c2025ef67494dabd69abac416c667) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:46.174784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:46.176244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388b6a5-5aad-43d6-89a3-860ba2be5800 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:46.189005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 162/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:38:46 2022] GET /identity/v3/role_assignments?user.id=ab3c2025ef67494dabd69abac416c667&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=6b7436af028945c885cc804dfdcb3587 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:46.695092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc958ee-d85d-4712-bf6f-ebfaf475b4f7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.695381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc958ee-d85d-4712-bf6f-ebfaf475b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.695831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc958ee-d85d-4712-bf6f-ebfaf475b4f7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.697287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 157/319] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:46.702452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e091ac-a47a-4d0d-b60b-14cd682f650e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.702914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e091ac-a47a-4d0d-b60b-14cd682f650e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.703087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e091ac-a47a-4d0d-b60b-14cd682f650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.720198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c4e091ac-a47a-4d0d-b60b-14cd682f650e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:46.721420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c4e091ac-a47a-4d0d-b60b-14cd682f650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:46.789440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 163/320] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:46.813250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc958ee-d85d-4712-bf6f-ebfaf475b4f7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:46.909245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:46.916750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc958ee-d85d-4712-bf6f-ebfaf475b4f7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:46.943630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db33-00ff-4402-97a5-bf20cce2aa32 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.943979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db33-00ff-4402-97a5-bf20cce2aa32 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.944358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27db33-00ff-4402-97a5-bf20cce2aa32 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.946217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 164/321] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:46.950682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.951017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.951375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.956151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:46.956978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:46.957326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:46.957537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:46.969278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:46.969533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:46.970892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:46.979081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:46.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:46.980766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 158/322] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:46.986538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.052399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 165/323] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:47.074959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.099669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10336-9454-4c2f-ad27-41b2f0f5abb3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.101237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:47.136871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.137801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.138171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.138550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.139474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:47.140001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.141639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523694-104a-4bb1-9ced-347a5e506960 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.150123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 159/324] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:47.151484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc704-2356-48bf-9181-abb1daea26d2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.151779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc704-2356-48bf-9181-abb1daea26d2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.152053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dc704-2356-48bf-9181-abb1daea26d2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.153309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 160/325] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:47.155195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dc704-2356-48bf-9181-abb1daea26d2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.174393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:47.182818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62477db8-6419-457a-9c6e-cca7965ef7f9 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.217123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.217915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.218198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.218469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.219627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.221119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a1584-6a64-4353-82ff-04d31c0469a5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.222748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 166/326] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:47.226500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.226789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.227069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.244574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:47.245821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:47.257537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dc704-2356-48bf-9181-abb1daea26d2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.290770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.291651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.291931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.292237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] PATH_INFO: `/v3/users/9b20a96bc4854473a2e848be157578de` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.293449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=9b20a96bc4854473a2e848be157578de)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.294899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.296579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 161/327] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/users/9b20a96bc4854473a2e848be157578de => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:47.301548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.311624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 167/328] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:47.312517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.336949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:47.410261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:47.410465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe316-c85d-4d94-a2a9-202bd2423417 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.424563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540fba7-3051-4b89-b059-bea2c713e7e1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.445346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.446015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.446299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.446580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.447412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] RBAC: Adding query filter params (role.id=e5abf678ad64422b8b09aa3e41a2befe, user.id=9b20a96bc4854473a2e848be157578de, scope.system=all) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:47.447728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.449208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.457712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.458432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.458711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.459036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] PATH_INFO: `/v3/groups` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.459775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.460958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 168/329] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/role_assignments?user.id=9b20a96bc4854473a2e848be157578de&scope.system=all&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 510 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:47.461305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.461755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.558355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:47.560100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 162/330] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Jul 5 12:38:47 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:38:47.593975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb071534-caff-4270-aac3-b6b47b723d01 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.637357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.638199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.638492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.638774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.653633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:47.661884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:47.662890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:47.663861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 169/331] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:47.669625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.774227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ce31c-a511-4433-8186-6a60da2919f3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.810004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.810623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.810908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.811187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.811952 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:47.812263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.813686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.822698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 163/332] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:47.828555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:47.939719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6692a9-1153-424e-82e1-181fb290a95f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:47.977637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:47.978536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:47.978821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:47.979098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] PATH_INFO: `/v3/users/9ecab7a9939f4a8887f6f20af200cefb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:47.980318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecab7a9939f4a8887f6f20af200cefb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:47.981830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442ebf9-2f18-47fd-a3c0-300a33476978 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:47.983867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 170/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:47 2022] GET /identity/v3/users/9ecab7a9939f4a8887f6f20af200cefb => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:47.989647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:48.002263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:48.104586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb14a-a238-4481-ac10-0397cdcf2250 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:48.142408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:48.143614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:48.144093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:48.144556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] PATH_INFO: `/v3/system/users/9ecab7a9939f4a8887f6f20af200cefb/roles/6b7436af028945c885cc804dfdcb3587` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:48.146280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ecab7a9939f4a8887f6f20af200cefb, role_id=6b7436af028945c885cc804dfdcb3587)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:48.148521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cba0a-11b8-4e00-a962-b90ab1032b91 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:48.217222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 164/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 5 12:38:47 2022] PUT /identity/v3/system/users/9ecab7a9939f4a8887f6f20af200cefb/roles/6b7436af028945c885cc804dfdcb3587 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:49.871958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a888-55d9-459c-af4f-8b50fe24409c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:49.872991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a888-55d9-459c-af4f-8b50fe24409c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:49.873507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a888-55d9-459c-af4f-8b50fe24409c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:49.875376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 171/335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:49.880260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:49.881085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:49.881631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:49.905449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:49.906994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:49.987405 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 165/336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:50.044851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a888-55d9-459c-af4f-8b50fe24409c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:50.057445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:50.170390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a888-55d9-459c-af4f-8b50fe24409c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:50.210982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:50.211800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.212091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.212371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.227925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c5e1308c-a96d-4ac1-a645-9f5188f0c4a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:50.236193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:50.237096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:50.237891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 172/337] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:50.245872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:50.248084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:50.360606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd352fd-7fdf-487d-990b-54d97d41439a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:50.375240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089863-7610-42cc-9b79-74634b72d445 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.375556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089863-7610-42cc-9b79-74634b72d445 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.375810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089863-7610-42cc-9b79-74634b72d445 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.377404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 173/338] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:50.394270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f589a9-7d67-494f-add7-52f3de44eb93 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.394577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f589a9-7d67-494f-add7-52f3de44eb93 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.394838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f589a9-7d67-494f-add7-52f3de44eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.411617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:50.412366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.412984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.413338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.414168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:50.414482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:50.415912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcd6b-2754-4fc1-84be-cd8e3a1cb6a6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:50.429611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 166/339] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:50.429611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37113-1987-4791-a050-acb2c20417fd None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.429611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37113-1987-4791-a050-acb2c20417fd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.429611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37113-1987-4791-a050-acb2c20417fd None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.429611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 167/340] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:50.430436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37113-1987-4791-a050-acb2c20417fd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:50.430591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f2f589a9-7d67-494f-add7-52f3de44eb93 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:50.431981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f2f589a9-7d67-494f-add7-52f3de44eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:50.524939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:50.574446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:50.581062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 174/341] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:50.584733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.584733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.584733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.604726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37113-1987-4791-a050-acb2c20417fd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:50.619398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:50.620605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:50.668533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:50.669226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:50.669569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:50.669852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:50.746127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 175/342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:50.747063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:50.825624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:50.827115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:50.934546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:50.945195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310de066-a070-41ca-a80a-b32062f92ff1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:50.978808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 168/343] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:38:50.979802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.001971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.031681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.032519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.032846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.033126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.065624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:51.078591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:51.079823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:51.080834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:51.082822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 176/344] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:51.088606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.093259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5da4c-6905-4634-9ca4-8e8ce524da15 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.130358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.131684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.131976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.132254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.150665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:51.158901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:51.160007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:51.161133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 169/345] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:51.165699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.224352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.291568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d84f-0cb6-45cd-81fa-5f9e3ae824bf None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.330301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85c98-9dc4-40da-b254-ed8ff973baaf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.364805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.366858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.367369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.367909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.368356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.369151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.369515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.369816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.369940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.370759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:51.371147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.371859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.372662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.373923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 177/346] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:51.374824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.382456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 170/347] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:51.383269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.460948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.509235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.512458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548d83-9082-4b42-8a3b-414645085863 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.529435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c697c-647a-4c99-b295-6f5317e3bc3c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.555225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.556230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.557829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.558337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.559309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:51.559842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.561606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.572342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 178/348] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:51.572651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.573559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.573851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.574130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.574410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.582521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.583999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc56683-9053-4106-bc98-eaf3e05efaec None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.587293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 171/349] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:51.589195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad84c0-23d9-46ec-9d3c-5fe4dfaf1dca None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.589486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad84c0-23d9-46ec-9d3c-5fe4dfaf1dca None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.589767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad84c0-23d9-46ec-9d3c-5fe4dfaf1dca None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.591794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 172/350] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:51.595828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad84c0-23d9-46ec-9d3c-5fe4dfaf1dca None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.703357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774f5c-c083-4aa0-9943-77d7fb1d030c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.723261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.739359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad84c0-23d9-46ec-9d3c-5fe4dfaf1dca None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:51.744249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.745228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.745772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.746230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.785234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:51.786001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:51.786362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:51.786734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:51.817606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:51.830628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.839417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.876911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:51.878385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c381a3-3f09-4d68-82cb-2f2751d333d4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:51.968941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 179/351] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:51.971185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:51.992650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.024052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 173/352] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:52.025541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f832-17bb-46de-b7be-5e1b72098351 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.025836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f832-17bb-46de-b7be-5e1b72098351 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.026182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f832-17bb-46de-b7be-5e1b72098351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.045154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-df03f832-17bb-46de-b7be-5e1b72098351 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:52.046372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-df03f832-17bb-46de-b7be-5e1b72098351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:52.101329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.109574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba75d1-eaa8-452a-b32e-e3ad9466809c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.124376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 174/353] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:52.125746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5480-5673-4b04-acad-17303def5ca2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.126044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5480-5673-4b04-acad-17303def5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.126323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5480-5673-4b04-acad-17303def5ca2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.127925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 175/354] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:52.128721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5480-5673-4b04-acad-17303def5ca2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.148293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.149000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.149285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.149562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.150487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=2384e30be7ae459b90db0724dfdb7b49) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:52.150809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:52.152271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:52.159785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 180/355] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:38:51 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:52.160653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.260610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5480-5673-4b04-acad-17303def5ca2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.290754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.308227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.308925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.309913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.309913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.311827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:52.313123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed5d42-7512-44c3-80ae-d583ee707691 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:52.315058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 176/356] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:52.316239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887f40-cb3e-4dfa-a74c-6bdaf77ab265 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.316524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887f40-cb3e-4dfa-a74c-6bdaf77ab265 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.316822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887f40-cb3e-4dfa-a74c-6bdaf77ab265 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.318071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 177/357] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:52.319834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.320076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.320634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.321125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852311f-a7fe-424e-8d62-bad45eac58df None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.339798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:52.341092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:52.366547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.367526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.367816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.368092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.369353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:52.370803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:52.372514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 181/358] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:52.374048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.397521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.439179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 178/359] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:52.440178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.504618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfa5d9-37f4-43ae-b009-c38e20abc41d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.553791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.554991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.555431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.555862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.569757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:52.570996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91d0c-f54f-4364-a274-2f19c336d52d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f0d0c0cc-2697-4770-b3f2-931af6cf88d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:52.580208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:52.581218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 182/360] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:52.589155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.589887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.589887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.604902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:52.606209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:52.612831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.625001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.625978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.626271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.626549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.628165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:52.629677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:52.632144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 179/361] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:52.632740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.693381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.698406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 183/362] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:52.700783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.778437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ce82-4564-45eb-b0d4-d967129fcbb0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.823595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.824806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.825288 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.825649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49951f-0cb1-482d-a972-2ff96a5b125c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.825909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.828950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:52.829559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:52.831372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 180/363] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:52.836642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.870847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:52.872037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:52.872543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:52.872958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:52.882987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:52.886896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:52.895249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:52.900112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 184/364] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:52.901205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:52.978654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a7fd-60cb-43ef-9861-c16dbab82a09 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:52.996749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:53.037151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.038534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14b81-aa08-4293-b3e6-c9b203a63660 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.039800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.040096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.040375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.042064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:53.042396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.043794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.055269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 181/365] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.056289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.084040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.085726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.085835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.086307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.087153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:53.088338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.090218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.096254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 185/366] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:38:52 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.097501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.195580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:53.208327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c22e-9ba8-4705-b563-49b961be7ddd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.251477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bacd6-c431-406b-9e37-01cd657281f1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.253942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.261224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.261534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.261791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.279027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:53.286746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:53.288218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:53.289099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 182/367] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:53.293685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.303961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.305121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.305643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.306207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.307419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=2384e30be7ae459b90db0724dfdb7b49) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:53.307961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.309827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.316637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 186/368] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.317745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.345910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:53.492208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be4d26-ef39-4fb9-aabb-3ad7be63da37 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.538323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df0b5-71f6-4d3f-9f12-5a30c216281a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.561837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.562537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.562889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.563151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.563926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:53.564297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.566132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.569951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:53.582906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 183/369] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.585532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.597107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.598076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.598373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.598713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] PATH_INFO: `/v3/users/9ecab7a9939f4a8887f6f20af200cefb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.601843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecab7a9939f4a8887f6f20af200cefb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.605074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.606805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 187/370] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/users/9ecab7a9939f4a8887f6f20af200cefb => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.609559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.783648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:53.789659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889a36-7810-4fa5-a0b9-0ee8a66605e7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.808453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e667-4953-4167-8fe2-b3291c487e15 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:53.853881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.854933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.855414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.855887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:53.856889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:53.857396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:53.859245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:53.880988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 184/371] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:53.882867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:53.883715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:53.884644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:53.885143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:53.885627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.028691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442cd80-1eb7-4b01-8c18-80bf1806ab6f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.053210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.063770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.064609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.064929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.065211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.066121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] RBAC: Adding query filter params (role.id=6b7436af028945c885cc804dfdcb3587, user.id=9ecab7a9939f4a8887f6f20af200cefb, scope.system=all) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:54.066444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.067909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.070003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.071517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.082687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 185/372] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/role_assignments?user.id=9ecab7a9939f4a8887f6f20af200cefb&scope.system=all&role.id=6b7436af028945c885cc804dfdcb3587 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:54.083624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.109270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.202189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17da7-9fc4-4d0c-8ccd-fe9064d7493b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.232697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:54.238916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.239185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.239805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.240099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.240438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.317955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.319502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.339527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.373104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84844d60-5594-4c4c-88fc-0418031a05a0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.415456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.416442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.416830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.417182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.418515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.420060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.422224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:54.422791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.431710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.447957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 186/375] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:38:54.458972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.593090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4fab6-f436-4587-af43-a15bbda4f7db None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.624108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.643955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.644869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.645158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.645442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] PATH_INFO: `/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.647217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] RBAC: Authorizing `identity:get_project(project_id=64ba694b123b4c2a9ad28d0d2ae13d58)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.648708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.650739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 187/376] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:54.659209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.727055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97a32-1fee-47a0-a116-a9c8d1335f4b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.802570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21161709-6494-45c4-b897-863800580508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.803783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161709-6494-45c4-b897-863800580508 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.804072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161709-6494-45c4-b897-863800580508 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.804352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161709-6494-45c4-b897-863800580508 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.806805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161709-6494-45c4-b897-863800580508 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.808370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161709-6494-45c4-b897-863800580508 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.814737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 190/377] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:54.814737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115ee6-6f4a-44d0-b99f-520b424fdbe9 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.814737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115ee6-6f4a-44d0-b99f-520b424fdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.814737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115ee6-6f4a-44d0-b99f-520b424fdbe9 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.822150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 191/378] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:54.822935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55115ee6-6f4a-44d0-b99f-520b424fdbe9 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:54.831018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16b2c-20e2-4447-a386-c46ea4649724 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:54.868243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:54.869077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.869367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.869650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] PATH_INFO: `/v3/groups/de92105edaf6490aa2cfe50c7d7997bd` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.875766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] RBAC: Authorizing `identity:get_group(group_id=de92105edaf6490aa2cfe50c7d7997bd)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:54.877254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddad2d6-506e-432c-978b-f5c5c16e4e25 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:54.879391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 188/379] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/groups/de92105edaf6490aa2cfe50c7d7997bd => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:54.880769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:54.882953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:54.883239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:54.895482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:54.903317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:54.904559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:54.969029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:55.012506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 189/380] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:55.013778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.061619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55115ee6-6f4a-44d0-b99f-520b424fdbe9 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:55.134063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:55.134653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.134938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.135213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.136052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:55.136360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:55.138041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:55.144999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 192/381] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:38:54 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:55.145820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.180992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afa6fd-cb01-489e-95ba-d01751648425 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:55.221767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:55.222467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.222756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.223046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.223908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] RBAC: Adding query filter params (group.id=de92105edaf6490aa2cfe50c7d7997bd, role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=64ba694b123b4c2a9ad28d0d2ae13d58) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:55.224418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:55.226320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:55.233266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 190/382] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/role_assignments?group.id=de92105edaf6490aa2cfe50c7d7997bd&scope.project.id=64ba694b123b4c2a9ad28d0d2ae13d58&role.id=ebbfe49b13964adab174b6721d50a779 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:55.332202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:55.344449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccb3b2-3a19-43f3-ae89-816816135d45 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:55.387937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:55.388769 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.389387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.389664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.403080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:55.411084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:55.412031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:55.413026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 193/383] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:55.419194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.485300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:55.544616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022118-585c-42fa-bdff-e9097505eea4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:55.589202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:55.589889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.590185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.590441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.591196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:55.591497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:55.592886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505828ff-1dfd-4bb9-bd19-5f7ce1de0e30 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:55.605337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 191/384] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:55.611096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.733493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bdeff-4fd7-4ea1-8a2b-16ae60b7c4d6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:55.758517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9200e2-fad7-4b49-bc05-f90f774a3313 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.758851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9200e2-fad7-4b49-bc05-f90f774a3313 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.759090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9200e2-fad7-4b49-bc05-f90f774a3313 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.760801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 192/385] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:55.766073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.766364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.766645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.783218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:55.784100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:55.784394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:55.784717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:55.785962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:55.786385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:55.787448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:55.788120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:55.789435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 194/386] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:55.796717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.849310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:55.920784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 193/387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:38:55.960266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:55.993221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338889-532c-42e8-8530-21e425fab580 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.032718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.055590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.056481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.056795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.057076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.059312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:56.060788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:56.064960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 195/388] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:56.070478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.137116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e01da1-01d2-4d2e-befd-3a1108cb847c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.174639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.175696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.176176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.176710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.188451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:56.194847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0565fc24-5f4d-4532-a13d-a1501a5b0afd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:56.199077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:56.202399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:56.203395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 194/389] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:56.204714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9b68-1bb0-40db-b64a-146bc704b74b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.205208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9b68-1bb0-40db-b64a-146bc704b74b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.205605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9b68-1bb0-40db-b64a-146bc704b74b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.207763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2511-be67-4dd8-a668-dca843eed2b6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.211410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 195/390] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:56.212473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9b68-1bb0-40db-b64a-146bc704b74b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.247696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.248513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.248853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.249134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/groups/434e21bde84c493d959a67b89e217dea/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.251250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, group_id=434e21bde84c493d959a67b89e217dea, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:56.253089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a99b8-9b8a-4d3a-8287-cdbcf0cd59ea None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:56.320326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.332702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 196/391] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 5 12:38:56 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/groups/434e21bde84c493d959a67b89e217dea/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:56.332702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.332702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.332702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.340130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9b68-1bb0-40db-b64a-146bc704b74b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.364914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:56.368703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:56.409524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.410276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.410568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.410846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.411623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:56.412038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:56.414027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:56.438330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 196/392] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:56.439348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.512443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 197/393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:56.545477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.595376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ca40-9384-41a6-96bc-89ec0b6084e7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.643601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.644489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.644819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.645107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.646324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:56.647948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:56.649829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 197/394] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:56 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:56.656062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.664355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.693278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.722916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef6c38-9a38-4c2b-8b04-3be117c51248 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.783174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02fb22-4316-45c9-a929-8e303d3ef6dd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.821371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.822560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.823287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.823574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.824844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:56.826308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:56.828199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 198/395] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:56 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:56.833717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.850542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.851497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.851798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.852064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.897877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:56.906240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:56.907105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:56.907898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:56.913400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 198/396] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:56.919117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:56.940745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7859f5-da04-40f1-9e67-a3b35c628e5e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:56.956779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:56.994960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:56.995864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:56.996153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:56.996437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/groups/434e21bde84c493d959a67b89e217dea/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:56.998489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, group_id=434e21bde84c493d959a67b89e217dea, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:57.000063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:57.058721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0367f-e136-4c5c-beee-02a3f790d498 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:57.073677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 199/397] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 5 12:38:56 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/groups/434e21bde84c493d959a67b89e217dea/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:38:57.120938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:57.121659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.121953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.122235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.123024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:57.123342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:57.124778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:57.135231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 199/398] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:57.140721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:57.255424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0653-522c-4e98-aa08-83a13417fab8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:57.300960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:57.301877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.302173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.302458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.304306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:57.305826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:57.307875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 200/399] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:57 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:57.313597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:57.317687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:57.432617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486638-a34f-4eca-825c-c2b429ce47d6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:57.468831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:57.469788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.470083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.470382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.471705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:57.473201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fde0-a1e6-428a-8629-45625e017e77 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:57.475596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 200/400] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:57 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:57.480960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:57.507680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:57.607798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b17c-5f4e-413a-95e2-349552bea1a8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:57.652463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:57.653398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.653688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.653969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49/groups/434e21bde84c493d959a67b89e217dea/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.658834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] RBAC: Authorizing `identity:create_grant(project_id=2384e30be7ae459b90db0724dfdb7b49, group_id=434e21bde84c493d959a67b89e217dea, role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:57.660294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fcad-4352-4d7e-b240-c5957cf4ca2c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:57.719532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 201/401] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 5 12:38:57 2022] PUT /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49/groups/434e21bde84c493d959a67b89e217dea/roles/26cba7b0722e440abff4c508da7eb0bb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:38:57.796204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b888e8-ee39-424c-af29-9aab15a405ab None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.796204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b888e8-ee39-424c-af29-9aab15a405ab None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.796204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b888e8-ee39-424c-af29-9aab15a405ab None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.804844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 201/402] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:57.804988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.805335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.805859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.816364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9c4d-4cc9-4b85-8788-c0da5be8c60e None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.816748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9c4d-4cc9-4b85-8788-c0da5be8c60e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.816973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9c4d-4cc9-4b85-8788-c0da5be8c60e None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.818558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 202/403] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:57.825047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:57.825372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:57.825603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:57.843454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:57.845156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:57.847441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:57.848973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:57.943144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 203/404] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:57.957704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 202/405] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:57.976301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:57.979075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:57.987456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.022883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:58.136060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e546e2-e440-4176-84ef-fddba9ca210c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.172666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.173513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.174069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.174502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.177548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e67cb-7cd9-4754-9d7c-9f9ec729d81d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.186134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:58.194792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:58.195735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:38:58.196517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:58.199261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 203/406] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:58.206495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.265408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.266631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.267117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.267576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.298301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:58.301499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:58.310389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:58.311313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:38:58.312102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:38:58.314935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 204/407] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:38:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:38:58.322043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.337927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705e3-f68c-4241-bca8-06798a2bbe19 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.383542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a735d-b713-4f55-b386-5821f324311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.384520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a735d-b713-4f55-b386-5821f324311b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.385434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a735d-b713-4f55-b386-5821f324311b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.385986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a735d-b713-4f55-b386-5821f324311b None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.387024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a735d-b713-4f55-b386-5821f324311b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:58.387472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a735d-b713-4f55-b386-5821f324311b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:58.389342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a735d-b713-4f55-b386-5821f324311b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:58.402817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 204/408] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:38:58.415580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a735d-b713-4f55-b386-5821f324311b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.452918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:58.566932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5f07-8e0f-4432-a91d-d7c82d9a6c06 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.574544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a735d-b713-4f55-b386-5821f324311b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.616873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.618604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.619034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.619502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] PATH_INFO: `/v3/groups/de92105edaf6490aa2cfe50c7d7997bd` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.620993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] RBAC: Authorizing `identity:get_group(group_id=de92105edaf6490aa2cfe50c7d7997bd)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:58.623190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:58.625791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 205/409] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:58 2022] GET /identity/v3/groups/de92105edaf6490aa2cfe50c7d7997bd => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:58.632136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.635418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:58.674755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.675512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.675772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.676030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.676827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:58.677138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:58.678730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:58.696470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 205/410] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:38:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:58.701900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.773969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d226d0-82e1-40df-a1f9-d774e6f146f8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.822267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.824159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.828081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.828919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] PATH_INFO: `/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.830486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] RBAC: Authorizing `identity:get_project(project_id=64ba694b123b4c2a9ad28d0d2ae13d58)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:58.833380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:58.839848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 206/411] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:58 2022] GET /identity/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:58.861411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:58.937056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81586c3-0cff-4916-a7f8-dbbe1d4969f7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:58.970727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:58.985527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:58.987988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.987988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:58.988283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:58.989712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:58.993671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28140197-9fe8-4374-a447-cee6b4b82dc4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:58.997054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 206/412] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:38:58 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:58.999249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfed-944f-4ed4-a4cc-5b30ecf1ee23 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:58.999840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfed-944f-4ed4-a4cc-5b30ecf1ee23 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.000354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfed-944f-4ed4-a4cc-5b30ecf1ee23 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.003728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 207/413] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:38:59.005060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bfed-944f-4ed4-a4cc-5b30ecf1ee23 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.021615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:59.053915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ab02-c65d-43ac-b2dc-6b14824a9a22 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.101186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:59.102848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.104225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.104753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] PATH_INFO: `/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58/groups/de92105edaf6490aa2cfe50c7d7997bd/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.106976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=64ba694b123b4c2a9ad28d0d2ae13d58, group_id=de92105edaf6490aa2cfe50c7d7997bd, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:59.108914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f0f0c-0636-447f-b865-9bae06c26b85 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:59.140520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bfed-944f-4ed4-a4cc-5b30ecf1ee23 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.184697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:59.184697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.184697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.184697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.188841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 207/414] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 5 12:38:58 2022] PUT /identity/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58/groups/de92105edaf6490aa2cfe50c7d7997bd/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:38:59.190656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.200923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.200923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.201125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:59.201125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:59.201125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 208/415] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:38:59 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:59.205812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.219105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:59.220904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:59.316142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 208/416] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:38:59.346058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:59.367755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.394636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74512ab0-6f43-4d82-b4b3-9cbb65b255a2 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.432848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:59.434766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.435058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.435344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/groups/434e21bde84c493d959a67b89e217dea/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.438041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af, group_id=434e21bde84c493d959a67b89e217dea, role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:59.439490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:59.462303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:59.509674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e8c8-c81b-41c1-a3c2-9e25de88c2a7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.545954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:59.554227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 209/417] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 5 12:38:59 2022] PUT /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af/groups/434e21bde84c493d959a67b89e217dea/roles/26cba7b0722e440abff4c508da7eb0bb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:38:59.554390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.554390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.554745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.572145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7fc650af-0c60-43dd-901f-2d3b49543c39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:38:59.583673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:38:59.585187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:38:59.586435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 209/418] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:38:59.591760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.702354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc463-4f9c-43bb-a8c1-e3b6aaa1ddbf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.702643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc463-4f9c-43bb-a8c1-e3b6aaa1ddbf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.702927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc463-4f9c-43bb-a8c1-e3b6aaa1ddbf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.704601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 210/419] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:38:59.715901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.716189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.716476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.731226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834e41-0680-4580-871a-a199227f3b5b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.757065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:38:59.758929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:38:59.760181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:38:59.775315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:38:59.776498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:38:59.776944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:38:59.777238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:38:59.778512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:38:59.778827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:38:59.780622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:38:59.792204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 210/420] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:38:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:38:59.797870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.879493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 211/421] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 12:38:59.905117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:38:59.957185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbd781-8fe7-4d9c-a76e-19247c723a47 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:38:59.965080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.010030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.010030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.010030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.010030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.039629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3cb41-0bf4-4c04-8bb5-53714b470492 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.070402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.091460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.093006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.109686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.110630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.110923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.111202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.136375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:00.153290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:00.154217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:39:00.155015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:00.155625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 212/422] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:00.161339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.277489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 211/423] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:00.282563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.357286 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab1e0-bbf3-4972-8a30-6790f4e6390b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.369514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.397618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.400156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.401030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.401321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.401598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.402362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:00.402669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.404520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de926-37da-4cb7-8152-daed93073ef7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.420274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:00.420274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df147dee-cff8-4a19-b87b-b6b32d2b14ef None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.420274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df147dee-cff8-4a19-b87b-b6b32d2b14ef None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.420274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df147dee-cff8-4a19-b87b-b6b32d2b14ef None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.420274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 214/425] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:00.421765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df147dee-cff8-4a19-b87b-b6b32d2b14ef None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.428852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc4e48-dc23-41b7-867d-077ada346d66 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.470526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.471921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.472712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.473219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.475503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.477598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832ab88-b681-4354-814d-0bd1c894b02a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.479967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 212/426] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:00.481468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.481970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.482454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.500456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:00.502311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:00.535217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df147dee-cff8-4a19-b87b-b6b32d2b14ef None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.574333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.575026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.575309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.575627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.578906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 213/427] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:00.585852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.621052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.649780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.651235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.695643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.716697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4997-a7fc-4ecd-b288-ae318a56e3b1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.755171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.756484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.757021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.757504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.759089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.760775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.766760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 215/428] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:39:00.766760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.767485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 214/429] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:00.768541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.841159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:00.875116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623359d0-3af8-412a-98dd-66c70994ce4f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.879064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4b629-13a5-40ce-b968-e8020ae64471 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:00.913641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.914446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.914729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.915001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.920161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:00.921717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:00.922537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:00.923104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:00.924872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:00.926562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:00.927177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:00.928883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 215/430] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:00.934409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:00.936086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:00.937032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:00.937835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 216/431] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:00.938570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:00.957361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.064346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3655-deea-493d-b2d9-4c7a36079d27 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.065825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06212-7d58-493b-b793-ee7f8d8b180c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.096991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.103903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.104846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.105079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.108338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.108338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.108875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.115352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 217/432] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:01.115352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.117973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.118649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.118932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.119206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.120049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=2384e30be7ae459b90db0724dfdb7b49) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:01.120360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.123531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.132112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 216/433] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:39:00 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:01.133899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.248290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.267436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3d6-d33b-4678-90a3-2ed0ae900b88 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.274739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4445-7e9e-4ed1-ade8-088de7501aab None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.319912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.321394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.321883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.322382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.323642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=e5abf678ad64422b8b09aa3e41a2befe, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:01.324161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.325884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.333455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 217/434] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=e5abf678ad64422b8b09aa3e41a2befe => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:01.348011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.348757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.349053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.349333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.350290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:01.350781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.352364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43dec9-d462-4d38-a254-bf020a490548 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.362872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 218/435] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:01.369888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.503864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9440a-de58-4da2-9f74-42e707cb55cd None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.519486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58cf74-116c-4478-985c-f086814997cc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.520014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58cf74-116c-4478-985c-f086814997cc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.520303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58cf74-116c-4478-985c-f086814997cc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.522133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 219/436] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:01.527496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.528063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.528543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.548078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.549546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.549546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.549546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.553330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:01.554565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:01.568084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.637076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.638067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.638551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.656235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:01.680038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.772532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 218/438] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:01.778186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.813393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7031-5550-45fe-a572-098e60fabceb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.827767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.853754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.854559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.854844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.855138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.866667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:01.874409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:01.875337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:01.876132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 221/439] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:01.882019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.887717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a85ff-c6b6-4eaa-9591-5c096026a9c9 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:01.926571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:01.928305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:01.928305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:01.928568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] PATH_INFO: `/v3/projects/2384e30be7ae459b90db0724dfdb7b49` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:01.929810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] RBAC: Authorizing `identity:get_project(project_id=2384e30be7ae459b90db0724dfdb7b49)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:01.931267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:01.933175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 219/440] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/projects/2384e30be7ae459b90db0724dfdb7b49 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:01.938251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:01.939428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:01.998129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303380-a899-4a26-8dd9-18bfd63e919e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.033621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.034303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.034588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.034861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.035621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:02.035935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.037476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.047415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.052484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.061415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952d75-bef8-4b51-b427-0226c404fc6f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.075029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.096962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.097929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.098299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.098655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.100195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.101724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.103366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 220/442] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:39:01 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.109164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.165141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f827d8-8892-40e1-824a-66b150840a83 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.179734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.199905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.200566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.200882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.203676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.213177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a87a9-120a-4fff-9aad-8fe40e16e049 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.246777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.247439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.247732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.248017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.248892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=2384e30be7ae459b90db0724dfdb7b49) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:02.249208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.250648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2975-8927-41bd-bd42-7e9e1445bf10 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.257040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 221/443] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=2384e30be7ae459b90db0724dfdb7b49&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.258266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4340-15b0-4a3c-83c3-ad3afbdaccc8 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.258559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4340-15b0-4a3c-83c3-ad3afbdaccc8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.258840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4340-15b0-4a3c-83c3-ad3afbdaccc8 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.260097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 222/444] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:02.265917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.266219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.266486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.285606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:02.286749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:02.287422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.288981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.335010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.365218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 223/445] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:02.389694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.406163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 223/446] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:39:02.411332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.429090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.514924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e9125-9937-4194-b6e3-5a80d58ffe5c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.531717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f775088-b88b-48a5-95ab-5e6089daa2fb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.557689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.558445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.558738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.559019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.570153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:02.571086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.571964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.572250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.572530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] PATH_INFO: `/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.574452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] RBAC: Authorizing `identity:get_project(project_id=64ba694b123b4c2a9ad28d0d2ae13d58)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.576035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.578080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 224/447] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/projects/64ba694b123b4c2a9ad28d0d2ae13d58 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:02.578381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:02.579353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:02.580196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:02.580979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 224/448] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:02.584711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.587732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.633887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.678379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.698090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3ff4-48bc-47c6-9dd2-6b7ee8bb3e79 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.719008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d0b62-8b5d-4ab3-9aef-f509d2d1f5f3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.739271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.740759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.741173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.741453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] PATH_INFO: `/v3/groups/de92105edaf6490aa2cfe50c7d7997bd` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.742721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] RBAC: Authorizing `identity:get_group(group_id=de92105edaf6490aa2cfe50c7d7997bd)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.744184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.745881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 225/449] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/groups/de92105edaf6490aa2cfe50c7d7997bd => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.751578 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.762348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.763032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.763320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.763598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.764363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:02.764695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.767178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.776926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 225/450] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.782632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:02.854746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5225c6-9e41-43ac-b6b0-f2864598adbc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.877330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:02.883245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc93d1-ba53-4c6f-85f4-fce483fa064b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:02.888831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.889501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.889788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.890068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.890903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] RBAC: Adding query filter params (group.id=de92105edaf6490aa2cfe50c7d7997bd, role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=64ba694b123b4c2a9ad28d0d2ae13d58) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:02.891221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.892656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:02.899240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 226/451] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/role_assignments?group.id=de92105edaf6490aa2cfe50c7d7997bd&scope.project.id=64ba694b123b4c2a9ad28d0d2ae13d58&role.id=ebbfe49b13964adab174b6721d50a779 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:02.919214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:02.919899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:02.920189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:02.920471 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:02.995777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:02.997309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:03.097611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:03.105523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:39:03.111598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:03.128951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:03.211397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33632f7-55e1-49df-a7de-e4dc2c35f5b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:03.244316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:03.245199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:03.245487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:03.245765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] PATH_INFO: `/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:03.246954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] RBAC: Authorizing `identity:get_project(project_id=39b4747d0b8c4331a77c1aa2a4d8a8af)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:03.248411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:03.250157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 227/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:39:03 2022] GET /identity/v3/projects/39b4747d0b8c4331a77c1aa2a4d8a8af => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:03.255707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:03.353271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751b0d-3b91-4f45-9310-2626af30f82f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:03.385988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:03.386816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:03.387102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:03.387383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] PATH_INFO: `/v3/groups/434e21bde84c493d959a67b89e217dea` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:03.388574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] RBAC: Authorizing `identity:get_group(group_id=434e21bde84c493d959a67b89e217dea)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:03.390059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688fac5-f77b-4fb5-8778-eeff670112fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:03.391656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 227/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 5 12:39:03 2022] GET /identity/v3/groups/434e21bde84c493d959a67b89e217dea => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:03.398017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:03.477744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:03.495637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b953-0aa2-4243-87c5-4eb58da94e16 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:03.528342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:03.529013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:03.529296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:03.529568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:03.530396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] RBAC: Adding query filter params (group.id=434e21bde84c493d959a67b89e217dea, role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:03.530706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:03.532128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3a5ef-54d8-49b9-a2f4-db3e40811baf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:03.538012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 228/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 5 12:39:03 2022] GET /identity/v3/role_assignments?group.id=434e21bde84c493d959a67b89e217dea&scope.project.id=39b4747d0b8c4331a77c1aa2a4d8a8af&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:06.249715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e007-e2f1-42bb-9b28-d7511e24b8bf None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.250230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e007-e2f1-42bb-9b28-d7511e24b8bf None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.250305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e007-e2f1-42bb-9b28-d7511e24b8bf None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.251849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 228/456] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:06.257899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f11c8-37bb-4146-afad-5e966b4f9db7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.258809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f11c8-37bb-4146-afad-5e966b4f9db7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.259255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f11c8-37bb-4146-afad-5e966b4f9db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.283922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f12f11c8-37bb-4146-afad-5e966b4f9db7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:06.285470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f12f11c8-37bb-4146-afad-5e966b4f9db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:06.346213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300da00-15b6-429e-96bf-b05f93265527 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.346836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300da00-15b6-429e-96bf-b05f93265527 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.347313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300da00-15b6-429e-96bf-b05f93265527 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.349520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 229/457] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:06.355223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.355802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.356279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.373112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 229/458] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:06.374869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe1b04-ef56-4246-b889-7042a4327c08 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.375340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe1b04-ef56-4246-b889-7042a4327c08 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.375826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe1b04-ef56-4246-b889-7042a4327c08 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.377657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 230/459] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:06.378703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:06.380336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:06.383278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.386858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.386858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.404610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:06.405843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:06.467368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:06.476491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 230/460] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:06.477730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.500700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 231/461] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:06.512583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.521575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:06.597033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72820c9-6f22-4636-8f5a-0ddfefeee960 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:06.639657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:06.640466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.640774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.641052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.650961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129e4a-f909-4a4b-9009-3fb7341cff1a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:06.652909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:06.654469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:06.675684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:06.676790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:06.678081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:06.678081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:06.678081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.678081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:06.679974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 231/462] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:06.680609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.696395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:06.698350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.699114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.699595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.715067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:06.717153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:06.731318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:06.740576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:06.741474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:06.742724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:06.742724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:06.742724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.742724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:06.742724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 232/463] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:06.743240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.787452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29294892-3827-4c55-862d-828e609c9d66 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:06.811622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:06.822662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:06.823466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.824810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.824810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.835744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:06.837252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cb7fa784-7473-40b3-b025-1204954131bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:06.857007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:06.858154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:06.864030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:06.864030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:06.864030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:06.864030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:06.864245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae38e2-d6f5-405a-a26b-29d99b0ffae2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 232/464] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80f27-b7f3-47a8-97c4-2665cdebda54 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80f27-b7f3-47a8-97c4-2665cdebda54 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80f27-b7f3-47a8-97c4-2665cdebda54 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 233/465] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:06.864318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80f27-b7f3-47a8-97c4-2665cdebda54 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.901388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:06.902056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:06.902339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:06.902612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:06.903334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:06.903642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:06.905060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:06.922862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 233/466] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:06.927759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:06.972408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:06.977959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80f27-b7f3-47a8-97c4-2665cdebda54 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.015581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dde691-8259-447d-b988-123c703b4796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.016245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde691-8259-447d-b988-123c703b4796 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.016528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde691-8259-447d-b988-123c703b4796 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.016839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde691-8259-447d-b988-123c703b4796 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.017998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dde691-8259-447d-b988-123c703b4796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:07.018307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dde691-8259-447d-b988-123c703b4796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.019684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dde691-8259-447d-b988-123c703b4796 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.031914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 234/467] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:07.033189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.033479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.033799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.042571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895876-202b-45a0-bc3f-84eb1ae50fb3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.050878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:07.053069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:07.062112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.079636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511416d-1284-4769-a359-dcb33849876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.080470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511416d-1284-4769-a359-dcb33849876b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.080823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511416d-1284-4769-a359-dcb33849876b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.081418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511416d-1284-4769-a359-dcb33849876b None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.082448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511416d-1284-4769-a359-dcb33849876b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:07.082765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511416d-1284-4769-a359-dcb33849876b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.085228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511416d-1284-4769-a359-dcb33849876b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.099284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 234/468] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:07.100224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511416d-1284-4769-a359-dcb33849876b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.124054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 235/469] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:07.125203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.217350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511416d-1284-4769-a359-dcb33849876b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.227237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.239968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bd902-9b07-4fdc-9265-8c0e8fe7664e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.256602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.257338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.259859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.259859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.259859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.260512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.275999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.276703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.277368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.277995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.279228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.280661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.329402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 235/470] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:07.330028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.358767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 236/471] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:07.359793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.377670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.493103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee7651-cb13-4034-9734-303ae8995523 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.541548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175501e-2581-4d7f-aef6-9e00ae849a9e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.564646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.565784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.566274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.566778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.567704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.569565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.592421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.593263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.597687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.597687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.607644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.609408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.612913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:07.629435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:07.631083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:07.632057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:07.632057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:07.632057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:07.632057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:07.632057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 237/472] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:07.637108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.687237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 236/473] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:07.761544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1b381-6c82-4698-8a6d-4d843211cf01 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.801875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:07.802749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.803152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.803437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.804189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:07.804502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:07.805949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cc7e-ab57-401e-8e16-383c9bea83ed None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:07.821638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 238/474] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:07.827239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:07.867065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9ebf-994a-49c2-9d05-285901599598 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.867378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9ebf-994a-49c2-9d05-285901599598 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.867626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9ebf-994a-49c2-9d05-285901599598 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.869263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 239/475] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:07.874230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:07.874514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:07.874784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:07.893257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:07.894389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:07.951566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.971002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 240/476] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:07.973909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:07.986129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ad5d-aca9-48aa-ba7d-a263fadb638a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:07.995595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:08.047469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:08.048535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:08.049264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:08.050330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:08.051242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:08.054758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:08.132014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8368-9326-45ab-89af-6db7d35e17f5 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:08.135953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 237/477] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:08.174800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:08.175844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:08.176346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:08.176868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:08.177977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:08.179821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:08.215315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.sql.core [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:39:08.215315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 12:39:08.215315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [parameters: {'id': '67ae01faaf96489c85440c84d8906440', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 12:39:08.215315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application result.read() Jul 05 12:39:08.237365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:39:08.238283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application yield resource Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise self.value Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application session.commit() Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:39:08.239182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:39:08.240147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:39:08.242479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application result.read() Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:39:08.244401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [parameters: {'id': '67ae01faaf96489c85440c84d8906440', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:08.246510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 12:39:08.252796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:08.257561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 241/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 5 12:39:07 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:08.263639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:08.388709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2f2e6-757b-466a-bcb5-99e391c6d6d2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:08.425194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:08.425938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:08.426226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:08.426509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:08.438283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6f1bb6bf-110c-44df-9646-8c71ae31816b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:08.447180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:08.448098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:08.448921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 238/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:08.455685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:08.531825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:08.599573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b38d-4840-4271-8162-015f10b5a2fe None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:08.638853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:08.639587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:08.639887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:08.640172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:08.640973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:08.641291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:08.642681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d24e2-62f4-4d43-9e12-856a0ef60273 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:08.654358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 242/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:09.865766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e12e9-9a14-4b3d-afe5-7fb735ab0add None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:09.866283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e12e9-9a14-4b3d-afe5-7fb735ab0add None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:09.866554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e12e9-9a14-4b3d-afe5-7fb735ab0add None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:09.868167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 239/481] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:09.873126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22612b5-337a-4577-98f2-f472cbb66814 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:09.873514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22612b5-337a-4577-98f2-f472cbb66814 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:09.873694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22612b5-337a-4577-98f2-f472cbb66814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:09.897663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e22612b5-337a-4577-98f2-f472cbb66814 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:09.899198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e22612b5-337a-4577-98f2-f472cbb66814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:09.988205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 243/482] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:10.018543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8da5-75ad-48fe-8d4e-0e7c6f98ae03 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.018841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8da5-75ad-48fe-8d4e-0e7c6f98ae03 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.021653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8da5-75ad-48fe-8d4e-0e7c6f98ae03 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.021653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 240/483] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:10.027249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.027552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.027835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.030756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c8da5-75ad-48fe-8d4e-0e7c6f98ae03 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.040554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.047205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:10.048613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:10.101166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.122720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 244/484] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:10.157183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.158979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c8da5-75ad-48fe-8d4e-0e7c6f98ae03 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.196965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.198113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.198504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.198792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.211043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5fdbb7b0-3819-4745-8b22-a8e6d824c6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:10.219604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:10.220453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:10.221302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 241/485] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:10.227101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348021-5d5e-469a-9f9e-c48bdc57a9cd None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.227232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348021-5d5e-469a-9f9e-c48bdc57a9cd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.227520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348021-5d5e-469a-9f9e-c48bdc57a9cd None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.229038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 242/486] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:10.233340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348021-5d5e-469a-9f9e-c48bdc57a9cd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.332465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434742-92f5-4fe7-8565-d8dc49358c9c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.333376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.373312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348021-5d5e-469a-9f9e-c48bdc57a9cd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.382906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.384234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.384771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.385301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.396662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e9ef2e30-96c3-43e6-94a2-f0bc2a018c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:10.405451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:10.406311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.407095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:10.409201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 245/487] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:10.414362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.414498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.414899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.418026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.418699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.418982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.419257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.420018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:10.420325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:10.421758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:10.435495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 243/488] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:10.435495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.440539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:10.441920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:10.476166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.525083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 246/489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:10.526301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.542430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced1f0a-713b-4245-8f65-3d91f683dd33 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.574848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.582978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.583884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.584406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.584786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.585610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:10.585983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:10.587421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:10.596299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 244/490] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:10.601536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.655229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86161a4-e016-4d8b-b111-71ccfcbb2ab7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.692368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.694050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.694484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.694936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.704863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366863f-a18a-4136-ba7b-edf5b794eab6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.706546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:10.708325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:10.728163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:10.729272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:10.730319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:10.730319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:10.730319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:10.730319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:10.737077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 247/491] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:10.738252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.743365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.744083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.744463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.744868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.756179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:10.764153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:10.765189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:10.766006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:10.770741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 245/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:10.772312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.797059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.823030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:10.855099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac8d1-7264-4cc6-83f9-3c194d954451 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.876027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc4fd7-ae0f-4c4d-aea6-62667252467e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:10.893703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.895105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.895593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.896748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.909501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:10.910274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:10.910938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.911046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:10.911216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.911489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.912385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:10.912715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:10.914104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:10.926036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 246/493] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:10.926854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a25cbe40-0bc2-4b0a-bdaa-587cdc872c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:10.931411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:10.932238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:10.933139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:10.933139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:10.933139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:10.933139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:10.933139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 248/494] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:10.938425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070b74-ef28-4efe-bd40-80e929ba1449 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:10.938425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070b74-ef28-4efe-bd40-80e929ba1449 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:10.938425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070b74-ef28-4efe-bd40-80e929ba1449 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:10.938425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 249/495] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:10.938425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef070b74-ef28-4efe-bd40-80e929ba1449 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.013825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.041698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f89c-a6a0-4983-8270-98ab777d2793 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.053403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef070b74-ef28-4efe-bd40-80e929ba1449 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.056543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.079950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.080625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.080937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.081369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.082012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:11.082252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.084256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.090087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.090892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.091180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.091460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.098082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 247/496] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:11.098082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.104538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.106041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-16055c0b-00be-4fe8-8a81-7e9f86dc1355 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:11.123138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:11.124132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:11.125092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 250/497] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:11.126339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.126339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.126519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.144626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:11.145853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:11.207105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e7d07-09ba-4022-a053-addf21dc58d9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.222624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 251/498] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:11.223746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.251283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.258063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.268488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 248/499] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:11.269650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.303193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.303392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.347870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd6706-7f49-4080-a084-91444ba5a7ed None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.378647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c933a16-9495-4cb7-86a5-11d1b6832bc1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.384563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.385396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.385681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.385967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.396472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.398157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:11.416943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:11.417824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 252/500] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:11.421457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.422600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.423329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.423626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.423913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.424808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:11.425834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.426575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.464017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 249/501] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:11.464891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.520777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f975-b980-4065-bdcc-02e49ce93d22 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.530660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.555125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.555448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.556015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.556305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.556587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.564580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa6c06-e4ac-4a6a-b91e-15e5adcd407f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.566900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:11.574689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:11.580904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 253/502] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:11.581703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.598058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.598883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.599298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.599574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.606470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.607934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-cf1f9471-1d24-4757-8f6b-25db494141c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:11.624896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:11.625851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:11.626727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 250/503] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:11.627531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324aa7f-ffa5-47be-bb25-2b2f04b05c04 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.627531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324aa7f-ffa5-47be-bb25-2b2f04b05c04 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.627822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324aa7f-ffa5-47be-bb25-2b2f04b05c04 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.629057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 251/504] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:11.629750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324aa7f-ffa5-47be-bb25-2b2f04b05c04 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.682394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0712e-c21d-4c86-b7f7-32394651a942 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.716277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.716905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.717195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.717476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.718204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:11.718514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.719910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.732108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 254/505] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:11.732942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.734207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324aa7f-ffa5-47be-bb25-2b2f04b05c04 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.760806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.767076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.767727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.768007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.768277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.787873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.831133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9356-27f2-42b9-b7bc-8f9db55cbb52 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:11.835186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.836726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208852e-1256-48d4-a9dd-33d022182f1c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.867247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:11.867920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.868205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.868481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.869266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:11.869576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:11.870951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:11.878712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 255/506] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:11.879491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:11.939753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 252/507] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:11.941066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:11.941351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:11.941622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:11.958114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:11.959851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:11.972441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:11.982127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c33f4-57af-4fac-963d-0009e942d4e5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.006976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.016321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.017044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.017328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.017611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.019077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:12.019077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.020186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.027832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 253/508] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:12.028691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.058661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 256/509] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:12.059362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.136968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d10a1-59da-4d24-b7db-e2fb9d08d8c3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.156436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb2e6d-ae4c-4507-a1b8-d12bffd689ea None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.170734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.171543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.171825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.172103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.179031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.180469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.189413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.190336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.190688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.191035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:12.195599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:12.196615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 254/510] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:12.197579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.205368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.206843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.216005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:12.230461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:12.231308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 257/511] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:12.232145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.244530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.303643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76e39e-b28a-4f62-8aaa-0e1d159eeccf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.333288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597217b-7be4-4ebd-ae43-fd1e8f2a9d03 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.337572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.338366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.338650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.338931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.348789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.350440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.367278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.368074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.368356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.368627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:12.368799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:12.369775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:12.370837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:12.370837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:12.370837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.370837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:12.370837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 255/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:12.371153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.382490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.383715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:12.401209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:12.402223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:12.403262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:12.403262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:12.403262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:12.403262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:12.403262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 258/513] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:12.403697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.457745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.466331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.474664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43daea-72d2-49b1-a85a-b5390f7f4947 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.505008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ecbf-b7d3-4756-b17a-81dfeb3c4a93 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.508923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.509570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.509851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.510123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.538981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.539655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.539938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.540223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.541099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:12.541413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.542868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.561231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 259/514] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:12.562037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.575925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.577414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.659442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4ab7b-8ca2-4e2d-b2f1-abd81dac4948 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.666174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.670910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.675134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 256/515] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:12.675942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.695831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.696572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.697053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.697343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.698077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:12.698392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.699773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.710737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 260/516] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:12.711630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.774685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4719de-a1a9-4a39-8bad-e87826693b16 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.808375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.809079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.809427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.809706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.810460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:12.810559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601c7c-9da1-4245-980b-007310ed37b3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.810771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.812144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.823801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 257/517] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:12.824595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.844169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.844873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.845163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.845441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.846172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:12.846487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:12.847888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:12.860009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 261/518] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:12.860828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:12.877744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.892878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:12.924326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfad37-799a-4325-baf6-c11716976893 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.957637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.958277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.958610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.958887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:12.961033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29b3a4-435a-4b03-8cd7-2e2c344e96d9 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:12.995214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:12.996005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:12.996287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:12.996563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.006610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.008072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.027192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.028606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:13.030110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:13.031130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:13.032068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:13.032068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:13.032068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:13.032068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:13.032068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 262/519] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:13.032353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.080850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.114434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.132543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 258/520] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:13.132543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.136660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884d919-5789-4501-a2b6-825e5fe1452f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.171879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.172728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.173003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.173287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.180269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.181777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:13.196474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:13.197435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:13.198318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 263/521] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:13.199001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.230275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4eae-1963-4299-9b72-e12a7e469572 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.264407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.265449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.265841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.266192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.274162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.275730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:13.299914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:13.300865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 259/522] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:13.301723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.309412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975b2a-0710-46f9-93db-963a71bfd68b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.312472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.342854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.343523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.343811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.344089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.344833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.346278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.404381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9e31-a190-41ad-af2f-4dc6e4c20bf8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.415720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.420895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 264/523] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:13 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:13.424247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.441510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.442203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.442489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.443354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.444128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:13.444486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.446034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.460710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 260/524] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:13.461526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.540379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.553554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1394a0-494b-4d1b-b6d6-e5c9ea36dbeb None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.574973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43c8a0-a070-4a82-a4d6-b192c6b23f83 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.592845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.593090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.593374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.593647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.605946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.607418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.622067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.622748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.623034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.623312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.624209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:13.624521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.626048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:13.627083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:13.627902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:13.628953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:13.628953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:13.628953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:13.628953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:13.629611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 265/525] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:13.630921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.645655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 261/526] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:13.647435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.688853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.743043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7691-aa9f-490d-abc8-29b171e4de56 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.749929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42cef-6c4d-4d83-92a7-d6b3a92aa424 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.780508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.780922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.781455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.781867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.782243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.783671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:13.784091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.785687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.786881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.788067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.788351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.788633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.795823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.797810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.805161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 266/527] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:13.810731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:13.813813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:13.814820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:13.815711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:13.824310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 262/528] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:13.825170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:13.923312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217287aa-1724-4e66-bbc0-053c496dce5a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.935628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:13.936218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55ecf-c607-4540-b28c-9fcc9066da7c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:13.960325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.961243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.961969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.962251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.962985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:13.963296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:13.964975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:13.971755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:13.972410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:13.972715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:13.973001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:13.983406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 267/529] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:13.984510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.040600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.050782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.052482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.101832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5f97-f81d-43ba-8a83-7c16b7f2653a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.137746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.138418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.138700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.138985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.139826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.140144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.141632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.148789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 268/530] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:14.148789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.166485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 263/531] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:14.167173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.216117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.278459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.291536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa21af-5c8c-463a-a324-8b1122f27da9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.295993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb31cc-1267-45d0-8762-4b406bce2095 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.331138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.331947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.332230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.332507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.337768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.338457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.338752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.339034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.339837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.340150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.340314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.341610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.341777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.356055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 269/532] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:14.356778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:14.357630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:14.358731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:14.359146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.359213 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 264/533] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:14.363809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.463638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.472031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf5bf-407a-460f-8f30-70d1635bf1a3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.472335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12a11-db03-4632-bcdb-8856f2719d26 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.511781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.512771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.513226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.513608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.516349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.517456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.517738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.518010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.518806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.519113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.520556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.526058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.527800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.543500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 265/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:14.544349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:14.551432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:14.553100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 270/535] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:14.554047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.564195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.678600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ea59-80df-44f4-81d2-1166c515d0b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.679579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd690cb-35a2-4110-9ad1-da3b537bd8e0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.719512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.720612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.721232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.721747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.722062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.722722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.723002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.723274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.723669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=4c4dafecd5b64ac6bbc26ac0a236ebfc) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.724141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=387a99329ad748118d233f4a2c644c4f) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.724454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.724863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.725933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.726762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.732873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 266/536] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/role_assignments?user.id=387a99329ad748118d233f4a2c644c4f&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:14.740721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.740933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 271/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/role_assignments?user.id=4c4dafecd5b64ac6bbc26ac0a236ebfc&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:14.871387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:14.899546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb5bf-19a8-4f3a-9525-a0a59a08f0df None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:14.941961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:14.942552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:14.943359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:14.943637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:14.944370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:14.944693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:14.946082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:14.963412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 267/538] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:14.968432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:14.982690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:15.113502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4044-403a-436a-9f04-c994af346308 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:15.160206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:15.161992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:15.162599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:15.163111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:15.170805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:15.172553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:15.196468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:15.197395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:15.198242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:15.200775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 272/539] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:15.209784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:15.326335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99176a-6660-4ec7-8553-1a778b976a07 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:15.362037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:15.362722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:15.363008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:15.363287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:15.364084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:15.364396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:15.366510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e35342-01b1-4ac0-a8b0-f5390a982466 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:15.368198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:15.378895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 268/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:15.384994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:15.479438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:15.518055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74ad0-3a3d-4a3b-be70-ca6675bee8d5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:15.571455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:15.572138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:15.572430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:15.572736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:15.573588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=20f2aac78555431ca685e3b43d27b099) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:15.573905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:15.575351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d297f2e-73d4-40a7-8b60-12dc72e4eed0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:15.585098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 273/541] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:15 2022] GET /identity/v3/role_assignments?user.id=20f2aac78555431ca685e3b43d27b099&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:15.768239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929b06-5c56-452c-ab53-88daa15e661a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:15.768527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929b06-5c56-452c-ab53-88daa15e661a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:15.768748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929b06-5c56-452c-ab53-88daa15e661a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:15.770411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 269/542] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:15.775955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:15.776284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:15.776538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:15.794371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:15.795594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:15.883708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 274/543] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:15.918194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929b06-5c56-452c-ab53-88daa15e661a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:16.076840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929b06-5c56-452c-ab53-88daa15e661a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:16.135766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:16.136594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.136993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.137275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.152059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:16.160652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:16.161772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:16.162700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:16.165412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 270/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:16.172806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:16.273674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:16.321526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48168b-351f-48b8-9c13-354c493da490 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:16.364374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:16.365683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.365971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.366254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.367025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:16.367338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:16.368755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:16.382600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 275/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:16.389179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:16.521641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:16.577097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806baf-9404-4429-862b-01ba14332153 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:16.624110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:16.624977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.625261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.625528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.637559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:16.639039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:16.662435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:16.663367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:16.664345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:16.664345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:16.664345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:16.664345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:16.664345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 271/546] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:16.673781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:16.830886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3474-3379-4a2f-8b6b-87fcbdf9818a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:16.858981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:16.875747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:16.876584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.876970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.877258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.877998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:16.878319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:16.879861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b3c66-be5f-47f2-8138-d23313ac6659 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:16.900517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 276/547] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:16.905987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:16.922236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1abb1-8302-4c1c-965b-acab1084dc15 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.922514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1abb1-8302-4c1c-965b-acab1084dc15 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.922799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1abb1-8302-4c1c-965b-acab1084dc15 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.924175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 277/548] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:16.936636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455c26-d72e-45a7-bccb-c2fab315b1c1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:16.936989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455c26-d72e-45a7-bccb-c2fab315b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:16.937232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455c26-d72e-45a7-bccb-c2fab315b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:16.965378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0f455c26-d72e-45a7-bccb-c2fab315b1c1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:16.966590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0f455c26-d72e-45a7-bccb-c2fab315b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:17.090984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 278/549] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:17.092380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b94d3-41cb-449b-9afd-71180086b898 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.092685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b94d3-41cb-449b-9afd-71180086b898 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.092979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b94d3-41cb-449b-9afd-71180086b898 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.097638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291b46-e4f0-4f1d-be1b-a0c1a271c44d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.098257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 279/550] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:17.099952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.100241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.100522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.105094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.118253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:17.119563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:17.142104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.142916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.143769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.144051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.156639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:17.158144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:17.177442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:17.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:17.179337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:17.179853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 272/551] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:17.185067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.204891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 280/552] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:17.205785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.274413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.319962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f56c-ac24-406a-8c6f-d38aa5b7ed61 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.336102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188045e9-85fb-43d7-80a2-d49ca3f8dfb2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.362184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.363207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.363557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.363775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.372593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.373295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.373581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.373855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.374695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:17.375006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:17.375106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:17.376441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddfca3-d94e-42df-ab22-ee0978a5e772 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:17.383011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:17.383905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 273/553] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:17.385359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.402592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 281/554] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:17.404224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2291-d94c-424c-94b1-4d1e9c1c70e6 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.404588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2291-d94c-424c-94b1-4d1e9c1c70e6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.404983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2291-d94c-424c-94b1-4d1e9c1c70e6 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.406504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 282/555] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:17.409423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2291-d94c-424c-94b1-4d1e9c1c70e6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.420971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.497194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8ae95-e96e-4077-8eca-95b1ba5a3336 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.523051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2291-d94c-424c-94b1-4d1e9c1c70e6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.525742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.533883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.534800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.548042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.548042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.548042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:17.554495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:17.555410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:17.556211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 274/556] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:17.557652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.564587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.565318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.565612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.565896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.566665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:17.566982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:17.568437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cac414-0ca5-42ec-983b-8cd226f0467b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:17.577810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 283/557] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:17.578954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.579252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.579530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.596458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:17.597712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:17.657586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.674295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36add1-dd22-45bb-9061-149d7aad97ad None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.685078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 284/558] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:17.685776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.717391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.718048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.718358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.718600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.796793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.800767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:17.803204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:17.803345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3830-f67e-49e0-bb69-a88acc898c26 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:17.842707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:17.843395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:17.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:17.844177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:17.845171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:17.845493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:17.847255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:17.856217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 285/559] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:17.857090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.897685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:17.914267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 275/560] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:17.914850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:17.975547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90af6a-0ba3-40c5-90a8-75d05b533b7c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.016350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.017186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.017467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.017747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.023915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0c0ee-1d3f-4ffc-98b9-fe78a92e6f8b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.029082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.030552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:18.047785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.048897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.049781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:18.049781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:18.049781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.049781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:18.050445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 286/561] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.051243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.057895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.058696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.058979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.059256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.064435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.070612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:18.078335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.079260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:18.080092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 276/562] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.081307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.126187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.159474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934236-1f1b-44fb-bccd-2af4cc939b04 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.178458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29326-51b2-4d95-98a7-0ed61527dfb1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.191995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.193349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.193634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.193909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.204223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.205712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.210985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.211775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.212058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.212337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.223332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-732da977-15ac-4479-9746-058ce2f415bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:18.223547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.226133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:18.226133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:18.226133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.226133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:18.226360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.226433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 287/563] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.227209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc71-7238-40ec-859f-3912b8e32131 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.227500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc71-7238-40ec-859f-3912b8e32131 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.227780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc71-7238-40ec-859f-3912b8e32131 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.229226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 288/564] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:18.229789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bcc71-7238-40ec-859f-3912b8e32131 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:18.246808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.247907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 277/565] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.253656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.295139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.337328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bcc71-7238-40ec-859f-3912b8e32131 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.346375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.350192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6778c-9b9b-4371-8f85-8a143f582d1b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.371710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.372380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.372687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.372978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.373708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:18.374023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.375401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.386136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.386812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.387104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.387388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.387636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 289/566] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:18.388178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:18.388432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.388535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.389886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c21-bb60-4064-b77c-bfc691106474 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.398052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 278/567] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:18.399499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.399790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.400072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.416126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:18.417352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:18.482902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 279/568] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:18.483971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.487547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8206-b6db-4cd4-a73f-9a7e314f27c7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.512193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.523524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.526509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.526509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.526509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.526509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:18.526509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.527203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.538510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 290/569] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:18.540376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.581890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.591332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018203c6-959e-4954-9d43-350da35b4d74 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.625726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.626396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.626684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.626960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.627685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:18.628023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.629430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.640043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9c8-24b0-40af-a8a8-3198f7e9393b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.641379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 280/570] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:18.642170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.674493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.675289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.675573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.675844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.684045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.685517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:18.699466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.700588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:18.701609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 291/571] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.702213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.744493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.751053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f119-3253-4edf-b8e4-24d28c81e0ee None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.784827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.785628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.785915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.786197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.796526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.798023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.802703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201e19-c33f-4b81-b61c-1c9411749273 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:18.816387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.817363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.818786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:18.818786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:18.818786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:18.818786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:18.818786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 281/572] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.819061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.822218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.841788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.842594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.842882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.843160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.854219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:18.862230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.863341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 292/573] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.865261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:18.922372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c07c2-f275-4941-82a1-be6377aa38c0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.956037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73994cad-7493-4015-af20-35da036de858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:18.956873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994cad-7493-4015-af20-35da036de858 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:18.957158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994cad-7493-4015-af20-35da036de858 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:18.957429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994cad-7493-4015-af20-35da036de858 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:18.965579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73994cad-7493-4015-af20-35da036de858 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:18.966662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834206-7617-4808-901e-36f8697ce322 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:18.967069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73994cad-7493-4015-af20-35da036de858 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:18.968172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-73994cad-7493-4015-af20-35da036de858 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:18.982718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:18.983966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:18.984936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 282/574] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:18.985533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73994cad-7493-4015-af20-35da036de858 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.006625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.007363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.007653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.007928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.015976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.017600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:19.032586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:19.033668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 293/575] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:19.035066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.050929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.090084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73994cad-7493-4015-af20-35da036de858 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.123807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.124484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.124826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.125112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.125962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.126280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.127736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.135381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be331a6-98c9-4c2d-93fc-845117f4520d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.144430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 283/576] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.145223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.169867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.170541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.170826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.171100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.171828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.172139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.173537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.184998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 294/577] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.185784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.210148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.248439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd7efe-9aaa-4b0d-ba89-4cae4af3780c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.267957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.281808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.282479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.282763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.283039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.283793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.284097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.285488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.285973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298adb-6eef-4adc-9dcc-e24da1508e1d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.293467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 284/578] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.294346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.354112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.354790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.355077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.355356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.356198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.356510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.357983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.375442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 295/579] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.376243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.420550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503c4f-cc91-41ec-a9b9-8fe763fb7c69 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.453905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.454595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.454740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.454880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.455152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.455938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.456245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.457696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.469413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 285/580] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.470195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.476182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ce4db-0f04-49f6-9bbe-82a0b558ca52 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.511302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.512100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.512377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.512647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.515201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.524341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.525761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:19.542923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:19.543853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:19.544864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:19.544864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:19.544864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.544864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:19.544864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 296/581] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:19.545553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.573800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acaedd-c585-4e70-a270-1b6510bc4838 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.608957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.609763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.610056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.610332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.617525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.618960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:19.634080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:19.635020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:19.635967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 286/582] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:19.636554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.648563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89ad0-1412-40b6-bdb6-b0209e500b68 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.678244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.683112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.683911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.686392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.686392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.695227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.696743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:19.714879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:19.715953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 297/583] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:19.716870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.744976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4f2b-207f-47e4-99d1-b7061f40aec3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.746574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.779037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.779760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.780048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.780318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.790282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.791731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:19.810167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:19.811160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:19.812083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:19.812083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:19.812083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:19.812083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:19.812083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 287/584] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:19.812363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.820926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bce04-fb2d-4180-aa22-01521c912383 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.855678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.856337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.856617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.856919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.857752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=6e7088e558ef4e778441a295dbf23500) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.858313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.859731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.865538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 298/585] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/role_assignments?user.id=6e7088e558ef4e778441a295dbf23500&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.866329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.916092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c18d4-7090-4937-99a4-10b87a3cac31 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:19.930514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.956257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:19.956978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:19.957269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:19.957570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:19.958849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:19.959153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:19.960794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:19.973175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 288/586] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:19.974135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:19.992648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:19.997011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf2bc9-a083-45b2-96c0-a248e323ed88 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.044750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.045359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.045649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.045930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.046785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.047100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.048544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.068205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 299/587] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.068885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.090963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af1257-bf77-46b1-be79-a649525e8cca None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.128379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.129335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.129778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.130132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.130968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.131279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.132725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.146517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 289/588] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.147342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.182686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6c1d-55e7-496d-a7b5-7a2c2cab9190 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.195804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.227006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.231139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.232128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.232417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.232733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.233897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.234585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.236293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.251937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 300/589] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.252222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a252-b5f2-4d77-a2df-5c08f6c29788 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.253332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.297835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.298567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.299080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.299201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.306440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.307911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:20.324728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:20.325766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:20.326637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 290/590] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:20.327117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.365886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c9d4-863b-4a54-a8da-68555fea4f4c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.403011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.403828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.404113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.404386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.416300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.417799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:20.435206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:20.436100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:20.437024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:20.437024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:20.437024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:20.437024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:20.437024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 301/591] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:20.437318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.440136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fd9f1-879d-4865-9f88-0ce0e02f4a53 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.462469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.478089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.481834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.481834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.481834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.481834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.489225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.490739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:20.505755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:20.506716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:20.507647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 291/592] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:20.508256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.560219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd3c7-8631-4d9b-928f-b8d6c1af36df None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.596916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.597845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.598132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.598413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.606344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.607977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.615922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db9cb5-7f8c-48f5-83fe-4c5199d195cd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:20.624168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:20.625086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:20.626002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 302/593] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:20.626497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.657996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.658780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.659060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.659339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.660135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.660447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.662277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.680893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 292/594] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.680893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.712458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.734365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f139-9fe1-4618-9f35-6ecaa7c317c7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.738797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.770971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.771646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.771924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.772208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.773144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.773338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.774734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.791414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 303/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.791414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.791643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6134cc-cd8b-4f42-be49-c7025dcc69b9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.828633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.829295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.829584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.829866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.830719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.831033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.832488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.850168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 293/596] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.850965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.906374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ef09-3ccb-4705-906e-3a0ab4bae330 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.945457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.946252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.946569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.946927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:20.947729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:20.948047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:20.949676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:20.956059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782e93-8ea4-4555-afcd-1db5991f278f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:20.958389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.965229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 304/597] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:20.965919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:20.972629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:20.995962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:20.996888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:20.997293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:20.997586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.013900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=90b3884fbabf435dab3e9a017e9d2379, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.015670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.083110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7da0-506d-4aaf-a9a4-9593dd895320 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.090065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 294/598] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:20 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:21.102209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.127974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.128912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.129257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.129552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.138897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.140757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:21.157223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:21.158198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:21.159083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:21.163820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 305/599] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:21.164879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.236753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:21.242606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde692-126e-47df-9ef9-dc2a3682683c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.287419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.288523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.289005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.289291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.291477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab5ff6-41a3-47f4-bba5-158c4af7536f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.299618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.301185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:21.323789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:21.324867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:21.325829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:21.325829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:21.325829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:21.325829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:21.325829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 295/600] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:21.326807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.343771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.345612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.346202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.346673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/387a99329ad748118d233f4a2c644c4f/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.349477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:21.372989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=387a99329ad748118d233f4a2c644c4f, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.374843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.437040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97a5a-4878-4e24-aad2-2174cf0db485 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.446852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 306/601] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:21 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/387a99329ad748118d233f4a2c644c4f/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:21.448516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.502202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.502910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.503198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.503478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.504316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:21.504629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.506304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.535366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 296/602] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:21.543323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.594347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bc35-0508-4cee-84d6-815c4632e07f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.606674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:21.641308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.642734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.643422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.643715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.644800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:21.645128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.647839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.663753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 307/603] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:21.669262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.677726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:21.714227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7aad-1130-487a-835c-0dfb4d977693 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.784460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.785468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.785755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.786033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/4c4dafecd5b64ac6bbc26ac0a236ebfc/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.815485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=4c4dafecd5b64ac6bbc26ac0a236ebfc, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.817235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5bfd-af9c-4878-9d66-70959c13b763 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.849383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ee6b1-1109-49c6-9d1d-5b9ba376e5b7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:21.886917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:21.887832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.888157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.888437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.896716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:21.898177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:21.914798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:21.915755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:21.916625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 308/604] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:21.922304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:21.935752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 297/605] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:21 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/4c4dafecd5b64ac6bbc26ac0a236ebfc/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:21.941506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7e56-3b94-48e4-98c9-765d62a3298e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.941758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7e56-3b94-48e4-98c9-765d62a3298e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.942342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7e56-3b94-48e4-98c9-765d62a3298e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.950955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 298/606] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:21.957519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:21.957855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:21.958155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:21.964661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:21.982501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:21.987303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:22.066571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 299/607] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:22.099739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:22.109533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a753c0-51a3-43fa-90d3-93277d68d59a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.158020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.159077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.159641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.160130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.161180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:22.162224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:22.162752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:22.164917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:22.182066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 309/608] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:22.186198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:22.210224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc0ff-ac28-4691-9d56-9dc81e074468 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.246470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.247275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.247545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.247812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.265764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:22.280632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:22.281607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:22.282540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 300/609] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:22.288290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:22.324900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:22.346389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3343d-da6f-4ae8-99a3-936665b7c223 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.420794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.421656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.421938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.422214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/20f2aac78555431ca685e3b43d27b099/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.453239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=20f2aac78555431ca685e3b43d27b099, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:22.454725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:22.476054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544dd1-9883-41b8-9523-7e9e42b1680a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.498191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:22.511400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.512078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.512381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.512641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.513420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:22.513726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:22.515092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:22.525351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 301/610] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:22.532266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 310/611] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:22 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/20f2aac78555431ca685e3b43d27b099/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:39:22.541339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:22.641946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f585c3b-3ad0-4e4e-9584-260badcfae1f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.678788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.679549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.679785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.680060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.690838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:22.692343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:22.711715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:22.712706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:22.713638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:22.713638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:22.713638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:22.713638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:22.713638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 302/612] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:22.718617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:22.873739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ebf1-21a0-4964-a90d-20471de559a1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:22.931798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:22.932401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:22.932698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:22.932985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:22.933718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:22.934025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:22.935402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:22.946740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:22.951941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 311/613] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:22.957584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.002957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:23.099017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f00da-9e05-4ad8-a22d-1c64fbf8c6a6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:23.133813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:23.134613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.134896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.135169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.142397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:23.143829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:23.158834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:23.159793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:23.160779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 303/614] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:23.169763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.329322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b497e4-3d30-4d0b-9890-9d163fdaf39e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:23.381387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:23.382074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.382357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.382634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.383489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:23.383800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:23.385285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9b92-96bb-49ca-9ba1-118a83fbc96b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:23.404279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 312/615] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:23.409874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.535857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:23.549042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a542-e534-4d2d-a88f-2c429cc72d53 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.553443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a542-e534-4d2d-a88f-2c429cc72d53 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.553443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a542-e534-4d2d-a88f-2c429cc72d53 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.553608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5013f-e790-416b-990c-25274dcfa774 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:23.553699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 313/616] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:23.557804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.558353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.558868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.577301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:23.578815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:23.615655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:23.616880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.618102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.618786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.639042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:23.641404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:23.660443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:23.661579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:23.662473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:23.662473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:23.662473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:23.662473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:23.673428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:23.677648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.684873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:23.714708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 314/618] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:23.768443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.860537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d909d6-1813-4978-acd6-d9fd6a507094 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:23.930437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:23.930630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050d6e-8231-4ace-b3a8-1c00ee1bdd58 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:23.931574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.932068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.932569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:23.933604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:23.934153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:23.935843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:23.945734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:23.950469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 305/619] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:23.955482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:23.995897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:23.997329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:23.997840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:23.998345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.018671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-63ab89ac-7dfd-4c6b-a313-b77c883bdb27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:24.027811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:24.028783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:24.029649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 315/620] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:24.030820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cd8-0ef9-4a6f-827f-546205106fe3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.030918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cd8-0ef9-4a6f-827f-546205106fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.031193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cd8-0ef9-4a6f-827f-546205106fe3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.037821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 316/621] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:24.042238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.042687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.043186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.062522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:24.063983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:24.116461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.121065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d61e-2600-49db-8e3f-5aa48a468e1d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.151479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 317/622] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:39:24.152631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.180083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.181190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.181520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.181920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.196691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.198335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:24.217899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:24.219064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:24.220175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:24.221622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 306/623] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:24.227524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.289892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83bb1-a5d9-4098-b8a6-1670817a86cc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.293164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.340100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.340779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037f1e5-c872-4e6e-a267-422b2644cfef None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.341638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.342103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.342840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.344683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:24.345210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.346912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.363295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 318/624] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:24.364665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.386289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.387103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.387392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.387675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.398456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:24.406395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:24.407359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:24.408245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:24.413168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 307/625] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:24.414326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.417329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.480898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f350162-9f74-44fd-a696-a45f661f7639 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.518636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.519314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.519602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.519885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.521225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:24.521552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.523019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.526429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ba2c-af2f-4a44-bd50-f6455c78e148 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.535004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 319/626] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:24.535821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.553297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.569283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.570535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.571008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.571467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.583818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.585903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-74fc07c8-52eb-4d35-8316-b26cd58b2440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:24.603754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:24.604715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 308/627] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def7d1-4306-4a17-8263-53d3dd02cb01 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def7d1-4306-4a17-8263-53d3dd02cb01 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.610832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def7d1-4306-4a17-8263-53d3dd02cb01 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.612610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 309/628] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:24.613416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def7d1-4306-4a17-8263-53d3dd02cb01 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.639929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.643572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5deb-0236-439f-9794-2badf216efe7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.680244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.681039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.681431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.681763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.682671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:24.682986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.684514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.697924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 320/629] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:24.697924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.733033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def7d1-4306-4a17-8263-53d3dd02cb01 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.768297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.769275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.769563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.769841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/6e7088e558ef4e778441a295dbf23500/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.785760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=6e7088e558ef4e778441a295dbf23500, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.787923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.804531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eef6f-5469-4580-882c-2269514324b7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:24.837438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:24.838110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.838401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.838683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.839419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:24.839737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:24.841165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12fe4-5854-4a96-990a-3ff7feb669c3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:24.857993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 321/630] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:24.857993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:24.857993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:24.857993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:24.872987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 310/631] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:24 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/6e7088e558ef4e778441a295dbf23500/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:24.872987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:24.880187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:24.881469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:24.900752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.909047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:24.972766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 322/632] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:24.974959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.030992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb09f-386a-4d98-9e33-8a1b0f621e2c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.073701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.074916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.075395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.075827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.087722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.089250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:25.107931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:25.109236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:25.110125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:25.110125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:25.110125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:25.110125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:25.110125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 311/633] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:25.110749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.121527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d453b3c-1343-49e0-98b4-e02262a84ed8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.157612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.158480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.158767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.159048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.166437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.167901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-117403ca-2e91-4777-9084-d7a7dae3263d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:25.182990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:25.184147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:25.185490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 323/634] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:25.186220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd6d-1152-40cc-a487-80972654fa9b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.186220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd6d-1152-40cc-a487-80972654fa9b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.186367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd6d-1152-40cc-a487-80972654fa9b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.187522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 324/635] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:25.188221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fdd6d-1152-40cc-a487-80972654fa9b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.202637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.205887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.232569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227511-3219-421d-b0b7-66378b4d2512 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.269786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.270858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.271351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.271838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.282872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:25.291101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:25.292214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:25.293207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:25.295276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 312/636] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:25.295276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.308408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fdd6d-1152-40cc-a487-80972654fa9b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.347053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.347851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.348133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.348416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.349261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:25.349667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.351087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41546e-2e06-416e-be02-476136ee2b9c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.368309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 325/637] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:25.368309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.368309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.368309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.384327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:25.385566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:25.415092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bd8d-c75f-44a2-ae6b-cb202520314b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.451491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.452256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.452454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.452763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.453627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:25.453944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.454279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.455748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.457460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.468691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 326/638] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:25.468691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.478665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 313/639] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:25.479585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.578129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cad09-12e1-4059-b30f-38e7234cc125 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.589246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9651a-0869-43f0-baaa-18120d164491 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.613041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.613717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.613999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.614436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.615232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:25.615540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.616948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.625536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 327/640] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:25.626440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.631824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.632631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.632962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.633235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.641770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.642189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:25.657999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:25.658976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:25.659915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 314/641] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:25.660536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.696375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.714990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.739272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24702-e465-405d-8a89-995a21cec541 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.762689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c394a-93da-443b-834e-5b94d90a43a7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.778575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.779514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.779799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.780080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.799901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.800721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.801061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.801339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.812618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:25.821375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:25.822567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 315/642] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:25.823433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.857596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.859535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:25.921413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.931090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61362-409f-4661-a13a-61a313ec6af7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:25.944583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:25.966133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:25.966936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:25.967223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:25.971883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:25.972022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 328/643] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:25.972022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:25.983349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:25.984850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:26.004619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:26.006433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 316/644] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:26.008163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.086625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd003-d69b-466d-bb3a-a08cefea0b15 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.116597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c82e-e914-4b1a-ad03-ba2b023ab221 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.123612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.124296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.124592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.124901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.125745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:26.126061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.127500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.146287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 329/645] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:26.146976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.159235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.159917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.160207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.160494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.161889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:26.162269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.163638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.175982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 317/646] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:26.175982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.176244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.206931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.261638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21876911-1be3-4b67-93cd-dc162b4ca58c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.288115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08a12-0fa3-42f9-9250-5c6776b9bd4f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.297440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.298240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.298535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.298812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.309105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.310553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.325680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.326646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.327140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.327647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.328593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:26.328999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:26.329898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:26.330776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:26.330776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:26.330776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.330776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:26.330776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 330/647] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:26.331063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.331577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.333605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.347571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 318/648] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:26.349926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.412027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.441805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.445298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92907b7-0aca-4ed8-9c75-a8bfef1a3d44 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.457480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb83-0b67-4b4e-aba1-b1a4007407db None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.483957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.484620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.484940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.485222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.494727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.495530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.495814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.496093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.507772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.509269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:26.528186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:26.529328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:26.530210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:26.530210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:26.530210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:26.530210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:26.530210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 319/649] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:26.531120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.565053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.568121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.632792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5c8b-b9d3-43b8-bd85-491e0b868543 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.647752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.670604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.671509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.671973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.672399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.673322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:26.673809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.675197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.684774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 331/650] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:26.684774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.687282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.691606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 320/651] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:26.692366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.786836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b28349-7617-4032-a53e-992cf6f48504 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.797517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa116dcc-25fb-4ab6-8870-9f19cd6d6c2e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.821056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.821866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.822150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.822426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.829668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.831112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.835273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.836148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:26.836631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:26.836969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:26.837726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:26.838043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:26.839437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:26.846045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:26.846948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 332/652] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:26.853902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.854565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 321/653] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:26.854565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:26.887896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.922063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:26.964392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4293-0d49-4c9c-9e6e-f3bfcb375e48 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.965041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273d1e6-80c1-40b7-9e66-7efbc05c7d9e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:26.998985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:26.999776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.000056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.000161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.000328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.001017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.001311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.001591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.007222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.008656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.013570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.015017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:27.024735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:27.025613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 322/654] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:27.026490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:27.033421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:27.034459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 333/655] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:27.037043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.121449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.132350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40a5cd-0549-4ff1-98bd-eb5ea6152afc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.137084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bddb9-7dd1-41b7-b245-f4c380ddb927 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.149174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.165963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.166632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.166912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.167191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.168020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:27.168330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.169791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0761-a7aa-4c74-b8a7-7f6520bff7ec None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.171553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.172406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.172636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.172940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.180662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.182121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.187846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 323/656] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:27.188967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03ede-4b42-4bf8-ad8d-aeed27b4b375 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.189254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03ede-4b42-4bf8-ad8d-aeed27b4b375 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.189527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03ede-4b42-4bf8-ad8d-aeed27b4b375 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.190852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 324/657] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:27.191415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03ede-4b42-4bf8-ad8d-aeed27b4b375 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:27.198979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:27.199935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:39:27.200904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:27.204692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 334/658] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:27.205431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.293212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03ede-4b42-4bf8-ad8d-aeed27b4b375 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.305233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd40a-6c80-410f-b12a-dd70e537f842 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.327922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.328833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.328948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.329164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.329960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:27.330270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.331705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.338716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.339383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.339670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.339953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.340698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:27.341015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.342368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67db29-337f-4995-adf9-d5d9be685c52 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.343087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 325/659] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:27.343906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.358331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 335/660] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:27.358331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.358331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.358331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.361892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.372932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:27.374113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:27.385961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.441355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 336/661] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:27.442199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.454424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec9f59-0ccb-4889-b818-0d4f5866080d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.487236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.487895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.488177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.488450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.543704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c35d8-5a41-44cc-bfe2-d0bfd6b5084d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.555903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.557431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.577662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.578338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.578626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.578908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.579756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:27.580068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.581542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.583263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.591108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.599838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 337/662] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:27.600657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.662804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 326/663] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:27.663641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.705312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cad47-ef17-4a16-b996-0598a270986c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.738089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.738744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.739034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.739897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.740860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:27.741068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.742491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.748371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 338/664] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:27.749189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.770462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899dfe1-0153-4a56-8f23-de366f560d1a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.809990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.811241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.811241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.811465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.814557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.817104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:27.820081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:27.821596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:27.836492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:27.837528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:27.838433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 327/665] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:27.839501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.870216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda20fb5-e5b5-41a8-aba5-788cb484fcdc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.909571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.910399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.910709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.911559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:27.922721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:27.931288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:27.932277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:27.933458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 339/666] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:27.934160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:27.959995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be111c-84fa-4e25-940a-5c4b3aa126fa None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:27.997155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:27.997799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:27.998088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:27.998371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.054439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8912d-c7a5-4013-97ef-759502391e93 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.072046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.073038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.078732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.080204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.090859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.091672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.091959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.092235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.103215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.104717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:28.123135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:28.124071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:28.124984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:28.124984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:28.124984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.124984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:28.124984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 340/667] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:28.125280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.186376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 328/668] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:28.189633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.237810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49c03-cde2-4404-97b7-7f50ab21c5cc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.276787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.277488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.277777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.278054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.278858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:28.279171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.280605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.294247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.300232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b8cfa-9c37-4d4c-9c78-58b6f3b5a53f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.301130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 341/669] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:28.302756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.331564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.339872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.340553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.340867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.341147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.341907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:28.342216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.343589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.356788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 329/670] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:28.357661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.408466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc872-6d94-4c05-b039-f4b87bf39bb7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.443624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.444304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.444599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.444921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.445661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:28.445973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.447354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.459174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 342/671] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:28.459920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.468793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e26f2-1d78-4ea1-9ab4-3268a106ec74 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.507585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db647-677f-4189-a902-dd062303c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.508312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db647-677f-4189-a902-dd062303c801 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.508599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db647-677f-4189-a902-dd062303c801 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.508907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db647-677f-4189-a902-dd062303c801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.520428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db647-677f-4189-a902-dd062303c801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.522721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db647-677f-4189-a902-dd062303c801 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f25db647-677f-4189-a902-dd062303c801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:28.542082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:28.543004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:28.543914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:28.543914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:28.543914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.543914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:28.543914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 330/672] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:28.544208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db647-677f-4189-a902-dd062303c801 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.557297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.557729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.570715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4029a79-354e-47be-a392-94244b3a59e4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.603557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.604227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.604511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.604821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.605652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=387a99329ad748118d233f4a2c644c4f) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:28.605965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.607409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.624699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 343/673] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/role_assignments?user.id=387a99329ad748118d233f4a2c644c4f&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:28.624699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.681985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db647-677f-4189-a902-dd062303c801 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.727792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.728734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.729113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.729465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.742140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.743731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.762045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17403-8691-4ce5-8095-b07ceab843d7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:28.776724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:28.777708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:28.778601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:28.778601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:28.778601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:28.778601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:28.778601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 331/674] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:28.778883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.808059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.808893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.809178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.809451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.819217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.820657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:28.839867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:28.840876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:28.841748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 344/675] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:28.846890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.858486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.866412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:28.907811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46edf1b-5943-4a96-b91b-b3f106e2aa10 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:28.954798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:28.955473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:28.955754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:28.956027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:28.956784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:28.957093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:28.958524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:28.971072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 332/676] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:28.971914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:28.986780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a842-83fb-4a36-b6c5-dc768e53bbc4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.036319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.037339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.038260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.038801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.039978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.040634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.042820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.059855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 345/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.061130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.090668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e271-d494-438b-b993-c254f7509068 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.114936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.127035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.128147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.128430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.128799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.130529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.130915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.132431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.148781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 333/678] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.148781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.163861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.206241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dba9-5361-4c1c-9471-bb058084baee None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.250480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.251561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.251995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.252414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.254870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b19f-67d4-40a4-9055-27dea53e716e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.260254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.262164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:29.277163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:29.278092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:29.278983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:29.281346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 346/679] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:29.282421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.292454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.293382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.293733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.294121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.302932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.304607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:29.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:29.321714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:29.322653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 334/680] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:29.323263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.368779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.396340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8826d-c032-4b60-95a4-87fd971934c7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.429118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775801-0741-43b1-810e-4f3254d9a845 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.430300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.436241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.437200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.437669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.438147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.439208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=4c4dafecd5b64ac6bbc26ac0a236ebfc) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.439824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.441486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.453080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 347/681] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/role_assignments?user.id=4c4dafecd5b64ac6bbc26ac0a236ebfc&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.454892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.480473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.481201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.481482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.481758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.482576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.482935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.484684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.511796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 335/682] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.517869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.666010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4115a73-5fa6-4a63-b3e4-00794631e003 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.686572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc943-3e44-4e00-8a79-bfb2acd86b82 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.688133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.707156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.708479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.709022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.709528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.710582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.711112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.712796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82224-6327-47c4-b56c-6c3151a82585 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.724242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.724569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.724943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.725221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.726119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=20f2aac78555431ca685e3b43d27b099) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:29.726428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.727864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:29.734432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 348/684] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.734596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 336/684] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/role_assignments?user.id=20f2aac78555431ca685e3b43d27b099&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:29.749633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:29.866937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237241ba-c2b7-40b4-8b24-2749461bd4b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:29.913541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:29.914217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.914498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.914769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.918718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853314c-0eec-425f-86f1-2599f4121c78 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.918718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853314c-0eec-425f-86f1-2599f4121c78 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.918920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853314c-0eec-425f-86f1-2599f4121c78 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.921272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 349/685] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:29.926100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:29.926394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:29.927336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:29.953281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:29.955518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:29.956937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:29.993894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:29.995720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.037869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.064910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 350/686] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:30.085717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.112737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 337/687] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:30.119890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.215103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8f4f7-d2fe-4f03-91c2-44a35fbf3668 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.227165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.256198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.257404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.257895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.258374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.274334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:30.283607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:30.284567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:30.285468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:30.286195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a3fd6-747a-4266-8e0b-8b9ee6e5658b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.292572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 351/688] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:30.295162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.329972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.330776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.331055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.331327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.344829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:30.346717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.349605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:30.371283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:30.378334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:30.379574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:30.379574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:30.379574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:30.379574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:30.379574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 338/689] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:30.381907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.459080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536106-f718-4814-8b64-34e883052e4b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.519997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a83297-c380-48ae-9d41-63810c582b3a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.545729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.546426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.546712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.546989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.547760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:30.548070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:30.549496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.550019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.559591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 352/690] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:30.565117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.589164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.590333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.594343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.595533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.596659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:30.599134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:30.601729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.623702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 339/691] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:30.629574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.736769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5efb1-cbea-4e9a-9f05-1b59756a2f51 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.774182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.775330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.775837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.776313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.784507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:30.786560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:30.802743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:30.803731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:30.804724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:30.807418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 340/692] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:30.812429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.857149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.886828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f802-fb79-4291-84c8-fa3a9d973d74 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.901547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:30.924493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176dd7-1db2-4b05-93c9-b0a9ffe3c38c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:30.963552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.964233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.964525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.964835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:30.965771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:30.966094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:30.967742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:30.981670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 341/693] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:30.988123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:30.994466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:30.995306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:30.996559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:30.996877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.022508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.024906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:31.056898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:31.057850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:31.058738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:31.058738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:31.058738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:31.058738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:31.059234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 353/694] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:31.065657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.141283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:31.147250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0657-1e46-4d8f-819b-da93a53b67b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.182965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ddaf7-5844-4a63-a930-5909bece2d55 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.194489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.195825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.196577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.197073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.198371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=6e7088e558ef4e778441a295dbf23500) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:31.199352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.201557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bd465-63f9-483e-98de-026bac4f40b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.210737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 342/695] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:30 2022] GET /identity/v3/role_assignments?user.id=6e7088e558ef4e778441a295dbf23500&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:31.212576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9adec-cb4e-4a5e-9d2c-09db6acc613b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.213038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9adec-cb4e-4a5e-9d2c-09db6acc613b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.213525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9adec-cb4e-4a5e-9d2c-09db6acc613b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.215282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 343/696] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:31.226432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.226633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.227173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.227359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.227477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.227719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.228121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.228467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:31.228848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.236504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.246539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 354/697] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:31.259648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.263370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:31.264932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:31.302198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:31.341178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 344/698] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:31.367115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.460163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950939-08e0-4e54-8d48-7603f9a2f77e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.498836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:31.502443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.503333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.503638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.504002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.509946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a7eb-8667-4a93-8a5a-ac179f6440b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.514046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.515574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:31.531289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:31.532276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:31.533261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 355/699] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:31.539353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.555361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.557026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.557315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.557589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.571000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.573482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:31.597620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:31.599267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:31.600304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:31.600304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:31.600304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:31.600304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:31.602545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 345/700] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:31.610434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.645151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:31.674636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff79b-1764-4b34-a7a4-fb6df7f11d31 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.724389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.725361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.725983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.726445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.728046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:31.728515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.729781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74d6fe-39c2-4c1f-bdb1-87b8aea019a8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.730311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.772041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 356/701] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:31.774993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.775893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.776332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.776791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.777952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.779207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:31.780041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:31.787725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:31.812864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 346/702] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:31.818353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:31.823910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:31.941091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb486-bc4e-43c9-8744-1c5408141937 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:31.985259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:31.986278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:31.986717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:31.987751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:31.992777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.037290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c99b1-b198-487e-844e-c808801f7529 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.078563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.080161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.080499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8980-7a2d-4c85-bba1-915fce16b7d8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.081009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.081361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.081709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.082552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.086007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffa40-030e-48a7-a22e-6996166e8e5d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.195349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 357/703] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:39:32.195349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ac16-5adc-4e69-a7ed-4d2d9e0a4177 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.195349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ac16-5adc-4e69-a7ed-4d2d9e0a4177 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.195349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ac16-5adc-4e69-a7ed-4d2d9e0a4177 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.195349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 358/704] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:32.197412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ac16-5adc-4e69-a7ed-4d2d9e0a4177 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.217366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 347/705] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:39:31 2022] POST /identity/v3/users => generated 254 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:39:32.218618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a28-29f3-4080-9855-869b276bcc3b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.218968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a28-29f3-4080-9855-869b276bcc3b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.219252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a28-29f3-4080-9855-869b276bcc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.255154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d8ec7a28-29f3-4080-9855-869b276bcc3b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:32.256456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8ec7a28-29f3-4080-9855-869b276bcc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:32.299787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.333648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.345396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 348/706] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:32.349349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a736-70db-4783-9a39-2dec293bfcb8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.349936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a736-70db-4783-9a39-2dec293bfcb8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.350223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83a736-70db-4783-9a39-2dec293bfcb8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.351658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 349/707] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:32.357302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.361284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.361284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.387957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ac16-5adc-4e69-a7ed-4d2d9e0a4177 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.389686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:32.391554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:32.430658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.431640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.431931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.432197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.446638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.448476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.468971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 350/708] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:32.469164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:32.470339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:32.471303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:32.471303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:32.471303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:32.471303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:32.471548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.471623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 359/709] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:32.484237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.582945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16f65-69af-4cf9-8e0f-62e5e3b0d82d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.604476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.606479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.622207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e497f0-b7b6-48ea-98cc-4367f983c7f6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.622735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.623761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.624276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.624795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.625689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.627341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:32.643137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:32.644417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:32.645433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.648067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 351/710] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:32.649192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.661199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.666193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.689169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 360/711] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:32.689169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.785402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb2de-92ae-462a-9719-596e8dd48313 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.807929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b5b2-b97e-4708-adb7-362c073cf42b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.833100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.834288 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.834572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.834841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] PATH_INFO: `/v3/services/network` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.837428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.839074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.850297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:32.850971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:32.851253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:32.851529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:32.852238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:32.852542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:32.853757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:32.854771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:32.855666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:32.856444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:32.859089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 352/712] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:32.860174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.865337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 361/713] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:32.866853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:32.883921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.927713 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:32.976246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0a76-17d6-460e-949a-daea23524705 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:32.991868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707c99-6c63-4c01-8958-21c7d7eb5303 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:33.024920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.026392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.027144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.027602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.028658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] RBAC: Adding query filter params (name=network) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:33.029501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.031336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.043058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 362/714] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:33.043058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:33.047254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.048243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.048703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.049154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.058629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.060791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:33.079315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:33.080252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:33.081161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 353/715] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:33.082298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:33.137476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:33.162879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165b5a-5e71-4308-9ba4-f6f5e4996d8e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:33.199948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.200623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.201100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.201430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.202192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:33.202546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.204023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.206649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8c1d5-c66a-452f-9243-a35ab4dadc24 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:33.210416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 363/716] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:33.211361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:33.219304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:33.255013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.256441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.256904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.257444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.258448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:33.259002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.260627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.267945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 354/717] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:33.372419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e9fd-ec09-4b44-b3d0-05a9cf18089b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:33.420150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.420829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.421121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.421401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.422224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:33.422536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.424033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06a71-d207-4ec6-92ad-63d97604b99d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.435342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:33.440140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 364/718] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:33.445838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:33.562053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b103-2ce0-4edc-a740-b0c6f30ee3d3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:33.601712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:33.602392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.602673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.602946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.603797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:33.604109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:33.605596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463ac2-b6dd-41b9-9302-2a697879fe4b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:33.612312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 355/719] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:33 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:33.803550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd99a6-abb5-46d8-a274-8430703f23b1 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.804074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd99a6-abb5-46d8-a274-8430703f23b1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.804151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd99a6-abb5-46d8-a274-8430703f23b1 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.805806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 365/720] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:33.811114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:33.811950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:33.812460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:33.833644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:33.834847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:33.867549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:33.914589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 356/721] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:33.943567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd99a6-abb5-46d8-a274-8430703f23b1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.093238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd99a6-abb5-46d8-a274-8430703f23b1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:34.138288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:34.139117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.139403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.139682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.153341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:34.161668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:34.162929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:34.164094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 366/722] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:34.169178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.300984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0a55e-8888-42d8-b586-c417d3914211 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:34.337075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:34.337670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.337959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.338240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.339006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:34.339318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:34.340706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:34.350558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 357/723] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:34.355745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.427056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:34.471228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa51a12-08be-4450-8ec4-3c1e73785e76 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:34.506455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:34.507275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.507563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.507845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.519629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:34.521820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2d35bf60-def8-452f-b78d-45c9468925fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:34.539088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:34.540023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:34.541040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:34.541040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:34.541040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:34.541040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:34.541040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 367/724] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:34.545872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.581065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:34.655542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ffb9-eac3-48f0-80b7-4000b33cfcc3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:34.662882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482249c3-e753-48c5-874d-055de5fccc98 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.663187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482249c3-e753-48c5-874d-055de5fccc98 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.663465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482249c3-e753-48c5-874d-055de5fccc98 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.665598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 368/725] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:34.672406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.672737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.672997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.695442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:34.704693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:34.713342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:34.714026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.714311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.714590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.715336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:34.715655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:34.717077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:34.746200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 358/726] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:34.749672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.846387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 369/727] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:34.886061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:34.893790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:34.902208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15b344-0cc7-4cd6-97c1-99aabe595082 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:34.955817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:34.956995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:34.958007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:34.958687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:34.968413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:34.972777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:34.989632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:34.996983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:34.998022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:34.998954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:35.007596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 359/728] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:35.016759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.092462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e968a-2c85-4d7f-9efd-eb234f99c661 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.146370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.147334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.147624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.147901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.159249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:35.176143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:35.177812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:35.178655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 370/729] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:35.186085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.224766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ed23f-e32a-4cb2-a6bf-4ab95b053ac5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.262075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.262933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.263320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.263703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.264660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:35.265101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.266888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:35.286860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 360/730] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:35.293979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.313223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:35.357965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f912-fdce-4869-85f5-edaf13443ad3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.364932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:35.401857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.402496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.402828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.403124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.403894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:35.404215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.405640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:35.415162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 371/731] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:35.425643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.461522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff133cd-be35-42d9-890c-a5e9ac902090 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.497454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.498162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.498516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.498859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.572234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.573860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:35.581848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:35.684210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 361/732] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:39:35.689810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.702568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2941fa-978d-4799-b4ee-2d5477e7a45f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.769465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.772202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.772692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.773373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.790333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.792192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-5f8c891f-7637-4a4c-92b2-7840d668bcca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:35.811273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:35.812200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:35.813141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:35.813141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:35.813141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:35.813141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:35.815262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 372/733] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:35.816750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4348-1584-4a5a-b658-2d7e810b510f None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.817294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4348-1584-4a5a-b658-2d7e810b510f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.817804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4348-1584-4a5a-b658-2d7e810b510f None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.819521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 373/734] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:35.820830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4348-1584-4a5a-b658-2d7e810b510f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:35.843255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:35.856539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f92b94-47b8-4076-a55a-05cdf5f46641 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.867100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:35.909966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.910937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.911293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.911836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.930477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.930477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:35.949785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4348-1584-4a5a-b658-2d7e810b510f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-35f799cc-8034-4ce6-a6c6-03f093958eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:35.950784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:35.951730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:35.952615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:35.952615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:35.952615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:35.952615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:35.952615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 362/735] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:35.958041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.958041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.958041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.974530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:35.975741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:35.993760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:35.994435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:35.994718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:35.994988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:35.995713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:35.996022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:35.997428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c604-4a57-4371-a85e-b9b85bdbe214 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.015874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 374/736] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:36.017494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c351b-ed4a-4fa3-88ea-e5e86b129652 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.017972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c351b-ed4a-4fa3-88ea-e5e86b129652 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.018572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c351b-ed4a-4fa3-88ea-e5e86b129652 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.021978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 375/737] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:36.025129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c351b-ed4a-4fa3-88ea-e5e86b129652 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.056879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 363/738] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:36.056879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.118665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.143588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c351b-ed4a-4fa3-88ea-e5e86b129652 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.146362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.158663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd650-bff1-4828-a403-93a2b9b00f11 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.182691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.183476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.183765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.184049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.184814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:36.185130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.186749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99d40-30c2-427a-bd57-e187b807a2e8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.194272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.195165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.195453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.195725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.204614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 376/739] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:36.204614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.204614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.204614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.206343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.208033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.218980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:36.220420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:36.223761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:36.224758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:36.225706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:36.229806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 364/740] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:36.230385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.298951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 377/741] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:39:36.299781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.344531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088a8e-7ea4-4415-9270-1b61dcd019c6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.364987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.380408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.381100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.381390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.381667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.382389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.383761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc8f8-c196-4f7d-b316-3480db85cd1f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.398805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068710-eb94-45a3-a3a6-674144a168fc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.432857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.433646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.433925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.434197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.440921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.442991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:36.456512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:36.458526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 378/742] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:36.459470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.486921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 365/743] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:39:36 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:36.486921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da5acc-8807-4d54-8b59-cb0ff12620a7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.486921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da5acc-8807-4d54-8b59-cb0ff12620a7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.486921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da5acc-8807-4d54-8b59-cb0ff12620a7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.487337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 366/744] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:36.487969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da5acc-8807-4d54-8b59-cb0ff12620a7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.509087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.576281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37706e-c313-4333-8eee-ce01d0c12168 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.608612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.618081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da5acc-8807-4d54-8b59-cb0ff12620a7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.620021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.620975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.621263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.621541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.622410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:36.622720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.624183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.650588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 379/745] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:36.651505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.660379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.661839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.662193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.662909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.663794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.665847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8fde4-c0cb-4d07-98c1-875e04e3afcd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.747084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 367/746] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:39:36 2022] POST /identity/v3/services => generated 240 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:36.753172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75321903-5ab1-4b3f-b775-24993c2d2d11 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:36.754246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.754627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.754915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.796231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:36.800140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:36.815163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:36.816217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:36.816447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:36.816901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:36.817900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:36.818375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:36.820036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:36.839932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 380/747] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:36.839932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.889956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.896715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:36.909116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 368/748] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:36.910293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:36.966279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9abc5-e4d1-49f6-99c0-cbe2e0253256 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.010532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.011207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.011499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.012037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.033622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e171-694f-4c7c-918b-6625134f2c82 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.074391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.075203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.075627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.076011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.077004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=6e7088e558ef4e778441a295dbf23500) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:37.077425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.078963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.084109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.085060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 369/749] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/role_assignments?user.id=6e7088e558ef4e778441a295dbf23500&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:37.085597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.086067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.174972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:37.206258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:37.277663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912399-ad46-4d5a-93d7-fb41b463b6f8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.281388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 381/750] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:39:37.286658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.361719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.363329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.365037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.365631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.387997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:37.396324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:37.397495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:37.398542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:37.408685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 370/751] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:37.417726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.495581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466b890-1c67-4040-8aa5-7b78d5357a19 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.538112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a431f-2fe4-4c5b-a847-f3ed123a0eeb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.557073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:37.561962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.562839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.563141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.563482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.572928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:37.577925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.580122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.584494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.585558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.586049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.586558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.587532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:37.589341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.590978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.607019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 371/752] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:37.612357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:37.616882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:37.617783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:37.618675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:37.618675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:37.618675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:37.618675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:37.618675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 382/753] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:37.630277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.751446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead88b2-fd6a-4003-b6cb-de4dd2e20f10 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.790140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.791879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.792169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.792448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.805518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.806982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:37.827609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:37.828558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:37.829478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:37.829478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:37.829478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:37.829478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:37.829478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 372/754] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:37.835221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:37.854834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93319233-f86f-4440-9a61-9a96ad763950 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:37.885387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:37.921171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:37.921855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:37.922143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:37.922432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:37.924263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:37.924589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:37.925985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:37.947280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 383/755] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:37.956522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.005202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e595-cbb4-4055-a60e-760d8e64182e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.068985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:38.090331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.091016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.091300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.091576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.092316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:38.092624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.094152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.128487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b71e4-60f6-483a-a3c7-4b4aec5499cd None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.132537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 373/756] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:38.136952 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.175951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.177328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.177834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.178318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.194944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.198039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:38.231624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:38.232712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:38.233888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:38.243354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 384/757] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:38.247101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.326172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:38.331782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd2a86-381a-4658-9aa0-843b9ca0e901 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.407421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.409039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.409560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.410132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.423408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.425343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:38.453525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:38.454571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:38.455520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:38.462827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8f7-6746-4b87-a8a8-20f9099b949b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.466715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 374/758] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:38.472005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.491680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:38.538436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.539092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.539432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.539715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.540567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:38.540845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.542460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.562845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 385/759] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:38.568598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.582006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad57ed-ecf4-4e7d-96f1-8ee64458bf6c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.626536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.627760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.629542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.629825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.630682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:38.631001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.632453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a324-3d1e-406f-9bcf-1b0643dce2e1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.652199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 375/760] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:38.653672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63230-78e1-4e01-a4bf-92a76083364f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.653967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63230-78e1-4e01-a4bf-92a76083364f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.654270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63230-78e1-4e01-a4bf-92a76083364f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.655855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 376/761] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:38.662469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d63230-78e1-4e01-a4bf-92a76083364f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.675573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:38.713423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88aa2f-35e7-4db8-9a96-c4970d90b9d2 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.752335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.754538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.754538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.754538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.754821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=158d55f449004896bd0abccbadbc48e5) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:38.754898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.756403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897afe-2091-47cf-bed9-0011873b401b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.765621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 386/762] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/role_assignments?user.id=158d55f449004896bd0abccbadbc48e5&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:38.767243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.767640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.768072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.781987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d63230-78e1-4e01-a4bf-92a76083364f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:38.791424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:38.794116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:38.822274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:38.823368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:38.823807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:38.824261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:38.831725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:38.836540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:38.838312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:38.856906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:38.857983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:38.859127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:38.859127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:38.859127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:38.859127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:38.861580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 377/763] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:38.869578 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.883055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 387/764] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:38.918099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:38.948254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.013432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8665b-6571-406d-a32c-12e95e128d97 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.048255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccd081-c91b-4ec2-9db9-1d248ae5c61d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.067532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.068216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.068504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.068859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.069607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:39.069937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.071357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.093458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 378/765] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:39.100401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.124307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.125164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.125457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.125761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.126439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.127877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:39.142474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:39.143449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:39.144281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 388/766] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 5 12:39:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:39.150016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.183714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.299733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a59e-9e45-4cdc-bd5c-df76982b5781 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.305997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf3b3-39b5-42bb-8b81-53ba647ce00e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.345875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.373356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.374048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.374339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.374622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.375358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:39.375670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.377078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.379919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.380752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.381045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.381329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.389148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.390642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.392103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 389/767] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:39.397929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d5b4316c-660b-40b3-869a-11bd43c23515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:39.411464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:39.412733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:39.414183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 379/768] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:39.414665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5964cce-7dbc-4f6c-b0ad-1a14f228ea69 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.414913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5964cce-7dbc-4f6c-b0ad-1a14f228ea69 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.415113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5964cce-7dbc-4f6c-b0ad-1a14f228ea69 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.416920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 380/769] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:39.418005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c6ed-661c-4850-a55b-8c5a72a8a96a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.418299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c6ed-661c-4850-a55b-8c5a72a8a96a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.418655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c6ed-661c-4850-a55b-8c5a72a8a96a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.421874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 381/770] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:39.421874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374c6ed-661c-4850-a55b-8c5a72a8a96a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.512903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.520530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f375d-3202-46d1-b198-945bd80b7699 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.528116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374c6ed-661c-4850-a55b-8c5a72a8a96a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.557830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.558838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.559304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.559761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.560618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:39.561220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.562932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8c85-9de4-4bbd-94a0-3bb8a88dfa1e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.563865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.564529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.564851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.565140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.565939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:39.566256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.568302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718bee6-bb61-446f-a3d4-e3f8824c4e60 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.570465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 390/771] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:39.571972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.572261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.572538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.584934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 382/772] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:39.586466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.586760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.587042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.594748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:39.596212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:39.605180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:39.606379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:39.647096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.673863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 391/773] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:39.674795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.682179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 383/774] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:39.683288 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.782475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:39.794859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4461-9647-4783-94d0-5f107ca09551 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.808473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c14be-6b29-4880-a61a-299b30c17e73 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.831487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.832162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.832504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.832916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.833720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] RBAC: Adding query filter params (interface=public, service_id=031ae5580aa34899ab6a0091b2a8d918, region_id=RegionOne) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:39.834037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.835405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.844809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 392/775] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/endpoints?service_id=031ae5580aa34899ab6a0091b2a8d918&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:39.844809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.850438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:39.851290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:39.851576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:39.851856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:39.853881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=90b3884fbabf435dab3e9a017e9d2379, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:39.855345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:39.923466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 384/776] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:39 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:39.924114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:39.960808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2742e5c-aa5f-4b61-9e6d-975e3f9fb874 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:39.964904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.008308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.009651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.010152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.010791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.012293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.014116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:40.030309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:40.031385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:40.032209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:40.041049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 393/777] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:40.041049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.064721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.078849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93fd3-a7b3-414b-a57e-664b08d6a534 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.130537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.131277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.131660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.131944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.144211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:40.153923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:40.154895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:40.155742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 385/778] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:40.156529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.170883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a01f5-b8c6-4aef-bc8c-bc0d107b71c2 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.208181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.208917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.209209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.209485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.210176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.211551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.217009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 394/779] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:40.217612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.284915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.304954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcd90-5199-4c30-adce-ad584f73941c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.372557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.373278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.373564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.373842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.374580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] RBAC: Adding query filter params (name=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:40.374889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.376298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.386324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.395073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 386/780] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:40.396455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.427798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ded97-0485-4dd9-aa42-7cc32286e93c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.465611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.466795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.467289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.467779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.468774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:40.469308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.470896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.484315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 395/781] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:40.487187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.526413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe580e-9cf1-45d8-99f6-82eeb90a3d88 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.563166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.563851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.564119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.564395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.565148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:40.565459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.567969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.577943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 387/782] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:40.580212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.611772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.615443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36898de9-44e8-4151-b380-f0baa5e409c3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.679578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.680314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.680594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.680898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.700450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.703193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.705162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:40.725896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:40.726869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:40.728229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:40.728229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:40.728229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:40.728229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:40.728229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 396/783] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:40.734989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.785151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367500-fed3-450f-ab6d-0a53d329eed2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.855743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5536-6e54-43f6-8871-e288838f88af None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:40.883949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.884623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.884935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.885210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.886013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] RBAC: Adding query filter params (interface=public, service_id=7c93d5ed963e4631ab46b3e2ea6d568d, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:40.886323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.887703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.904650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:40.905335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:40.905620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:40.905896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:40.906690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:40.906931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:40.908290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:40.911997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 388/784] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/endpoints?service_id=7c93d5ed963e4631ab46b3e2ea6d568d&interface=public®ion_id=RegionOne => generated 194 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:40.917972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:40.937106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 397/785] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:40.944845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.055883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.093510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.117866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210e00-b2a0-4f30-a543-d557ed8d285b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.131758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1550560-0cd5-475a-ae14-1b0ccaedd1b4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.155675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.156321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.156607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.156921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.157745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.159255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc8912-6e58-4702-b6e2-fee1bf888e1f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.165659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 389/786] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/services => generated 772 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:41.167013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030e12-dc08-471f-8295-cf375adac7cf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.167307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030e12-dc08-471f-8295-cf375adac7cf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.167687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030e12-dc08-471f-8295-cf375adac7cf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.170746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.171574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.172116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.172116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.173120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 390/787] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:41.174759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.175056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.175340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.181491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.184116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.195528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:41.196782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:41.203648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:41.204689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:41.206126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 398/788] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:41.211351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.353126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 391/789] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:41.363348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc843e89-dcea-4184-8e04-6792788c10f6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.389570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.390403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.418206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.419002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.419393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.419682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.420655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:41.421065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.422628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.442456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 399/790] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:41.455585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.485224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.513010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b091b5-0be1-4d99-bced-ff421b49f7fa None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.553274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.554371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.554664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.554948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.566412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:41.575276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:41.576208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:41.577499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 392/791] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:41.584572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.594076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81e8-695f-435c-aff4-2e5e882fd82d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.640660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.641807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.645901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.646444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.669195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.671654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:41.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:41.719217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:41.720118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:41.720118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:41.720118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:41.720118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:41.723729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 400/792] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:41.728161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.784532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.854238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa1420-de96-4e5c-876e-b034f36547cf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.899457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120a31-7173-4eba-a80a-525158cde668 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:41.910736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.911720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.912163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.912592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.913532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:41.914566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.917835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.927862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:41.939360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 393/793] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:41.944915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:41.959789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:41.960786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:41.961227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:41.961661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:41.963444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:41.963939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:41.965514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:41.978696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 401/794] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:41.984725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.132707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bb307-edf7-405a-bd4d-bc01f9f37fa7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.150614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.182515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d97c95-c0ec-4fec-8f36-93d13381402d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.200972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.202596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.202885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.203166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.219207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.220988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.234080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.235116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.235573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.235998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5ddc54e6-a171-4fd8-9d23-bde2974bd488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:42.242621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:42.243723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:42.244849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:42.244849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:42.244849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:42.244849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:42.244849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 394/795] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:42.246263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.247873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.249959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cac93e-a191-4f67-9034-7c290cfe5be1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.250571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cac93e-a191-4f67-9034-7c290cfe5be1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.252106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cac93e-a191-4f67-9034-7c290cfe5be1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.259028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 395/796] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:42.259028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cac93e-a191-4f67-9034-7c290cfe5be1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-32042608-af3a-4e14-baff-58dc75bfa394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:42.274656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:42.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:42.276455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:42.278212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 402/797] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:42.283432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.283432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.283432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.306450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:42.307997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:42.326285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.380296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cac93e-a191-4f67-9034-7c290cfe5be1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.396993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 403/798] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:42.396993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.442815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.443745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.444180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.444630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.446295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:42.447029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.449314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.462124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 396/799] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:42.463224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.481278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.509396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ab83-cdf7-417d-812e-4f2980b48669 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.548167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.548879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.549314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.549602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.550408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:42.550724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.552959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.566667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 404/800] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:42.567617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.576032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521727c0-0e9b-440d-9f56-8258d324fdf3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.590911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.614878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.615801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.616093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.616371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.628535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:42.636937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:42.638009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:42.638853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 397/801] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:42.639548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.684728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562793-ffa6-4ab7-a78b-82469dc8d55d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.721152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.722432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.723568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.724136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.726447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.733510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.735211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:42.751341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:42.752311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:42.753452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 405/802] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:42.754852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.759969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c22f-b6b7-4b1b-ba8c-0f76f5976e67 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.801717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.802613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.802909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.803169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/6e7088e558ef4e778441a295dbf23500/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.806396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=6e7088e558ef4e778441a295dbf23500, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.807833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f1bf4-9bfe-4e0e-a199-512bba773f4d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.864653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f199-5ead-40b2-8ac5-82a7de06fbb0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:42.877996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 398/803] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:42 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/6e7088e558ef4e778441a295dbf23500/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:42.880065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766cb1b-ac83-4670-8cd9-0c13f43177b1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.880357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766cb1b-ac83-4670-8cd9-0c13f43177b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.880635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766cb1b-ac83-4670-8cd9-0c13f43177b1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.882211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 399/804] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:42.887203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766cb1b-ac83-4670-8cd9-0c13f43177b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:42.917383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:42.918460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.918988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.919489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.920494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:42.921048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:42.923120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830a4fe-cd3e-4556-8dae-e9ca5927c5af None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:42.934655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 406/805] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:42.936534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:42.937097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:42.937591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:42.940458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:42.963834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:42.966011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:43.038372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766cb1b-ac83-4670-8cd9-0c13f43177b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.039538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.067548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 407/806] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:43.069137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.100174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.100914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.101228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.101827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.102960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.103272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.105197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.130426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 400/807] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:39:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:43.131283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.202478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de52fe-016d-417d-988b-5e74b9a26c43 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.250694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.255206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.256210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.264613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.264613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.264854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826591-8798-463e-b724-ffad222cd3e0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.270202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.271735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:43.298926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:43.299884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 408/808] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:43.301363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.307019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.307848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.308135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.308414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.309161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.310656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:43.324942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:43.325966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:43.326828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 401/809] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:43.327750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.347669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.413172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded68-20ef-42c8-b7dd-aa0bc8bcad95 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.438697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7612cf-683d-489c-aaab-4fe681637ae2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.450065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.451173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.451708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.452196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.464295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.467052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.475709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.476391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.476685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.476970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.477709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.478017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.479520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.492697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 402/810] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:43.493621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:43.494056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:43.494941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:43.495867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:43.495867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:43.495867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:43.495867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:43.499081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 409/811] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:43.500055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.515760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.609601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d9c5-634c-4cac-a392-3b698b896130 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.621779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.637157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03aec-f28d-4066-89ec-f160f2adfd3b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.652465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.653172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.653456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.653731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.654448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.654756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.656145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.662693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 403/812] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:43.663577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.678632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.679444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.679737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.680008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.688022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.689496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-6d0f37b2-c9c7-44d2-9b27-d883b08d84d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:43.704429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:43.705418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:43.706347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 410/813] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:43.707653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aecab-712f-4973-92cf-b23e6b7a492e None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.707653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aecab-712f-4973-92cf-b23e6b7a492e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.707826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aecab-712f-4973-92cf-b23e6b7a492e None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.713727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 411/814] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:43.713727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299aecab-712f-4973-92cf-b23e6b7a492e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.761812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.784280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d309-63fb-4bf4-a516-9d2c14f8159a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.820007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299aecab-712f-4973-92cf-b23e6b7a492e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.821977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.822656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.822939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.823221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.823952 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.824261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.825657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.837716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 404/815] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:43.838508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.863118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.864088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.864376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.864665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.865414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.865740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.867120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c549dc-ca1c-423f-8025-ca74e8eb7e53 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:43.872187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 412/816] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:43.873240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.873536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.873819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.890211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:43.891405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:43.901890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:43.954577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9100a-9295-4bc5-8373-e57c771ae18f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:43.965120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 413/817] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:43.965120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:43.993250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:43.994017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:43.994302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:43.994577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:43.995416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:43.995727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:43.997178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.006455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.022124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 405/818] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:44.022124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.103020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aea66-1ccc-4b8b-ab17-2aa0cd4c48d2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.134761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a58-8f63-4d5f-847d-6696f9a2156c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.139088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.140002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.140389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.140805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.147846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.149431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:44.164392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:44.165546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:44.166638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:44.167466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 414/819] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:44.167466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.177490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.177647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.178386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.178739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.179085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.179900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.181368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.271687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb8a06-7a10-4073-9634-843f0a50b7d3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.305547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.306344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.306626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.306901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] PATH_INFO: `/v3/services/network` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.307557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.308946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:44.320374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:44.321704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:44.322649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 415/820] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:44.323445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.369196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 406/821] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:39:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:44.370432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.405636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.447376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.458171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353627-b412-4b68-88f8-72e9ece139be None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.508343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.509638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.510324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.510781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.515731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6dab-68ca-450b-9d16-0d8fd775e97f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.571814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.572517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.573044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.573424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.574258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:44.574572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.576072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.593518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 407/822] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:44.594650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.704710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b744d7-8e7f-4b0b-85e8-4d577ff5d3fd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.709259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.710930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.719486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.742541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.743227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.743571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.743854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.744623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:44.744959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.746340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.755630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 408/823] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:44.756496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.793088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:44.817085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 416/824] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:39:44.818530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:44.864859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45249d-36d9-416f-a588-4d4da58b4ee0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.903857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.905002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.905290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.905571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/158d55f449004896bd0abccbadbc48e5/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.922478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=158d55f449004896bd0abccbadbc48e5, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.923917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f8bd-9c83-4684-bd38-53def7a37f09 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:44.924055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.960342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:44.961051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:44.961338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:44.961615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:44.962326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] RBAC: Adding query filter params (type=network) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:44.962635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:44.964006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:44.969293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 417/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:44.974973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.005405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.008255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 409/826] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:44 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/158d55f449004896bd0abccbadbc48e5/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:45.010079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.072388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.112921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081b392-8653-4749-9fc3-5cc5fdb1ac24 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.154238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.155063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.155360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.156009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.158699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abc26-bde9-4eeb-9968-2688b12294f3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.170517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.172333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cc5a344d-af31-4602-ba3d-4cd857911596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:45.195289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:45.196274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:45.197267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:45.197267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:45.197267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:45.197267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:45.197267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 418/827] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:45.198540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297414-4635-4c5f-929f-7ead045bcb2c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.198540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297414-4635-4c5f-929f-7ead045bcb2c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.198808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297414-4635-4c5f-929f-7ead045bcb2c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.200043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 419/828] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:45.202277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75297414-4635-4c5f-929f-7ead045bcb2c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.208161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.208883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.209178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.209465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.210237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.211711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116a574-8b61-4eda-8bb6-665463bd24e3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.294362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.309038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 410/829] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:39:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:45.320245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.320587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.321029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.347625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75297414-4635-4c5f-929f-7ead045bcb2c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.357629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:45.361562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:45.426451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.427154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.427442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.427723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.430226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:45.430549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.431971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.459679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 420/830] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:45.466533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.508847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 411/831] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:45.529955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.553496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.607638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267fc7-b8d9-46c1-9265-509e073f8d59 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.657514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.658891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.659182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.659464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.664043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.668520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a30d3-8998-42b2-88cd-5dd4decd48f2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.671992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.671992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:45.690496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:45.691525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:45.696768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 421/832] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:45.697516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.715482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.716294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.716659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.717044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.730554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:45.740066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:45.741197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:45.742512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 412/833] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:45.749638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.825211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450444e-882e-4df1-8d13-fbe362e5c18f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.835365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:45.863197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.864296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.864803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.865270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.866279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:45.866784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.868211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b638e7-68ac-41ca-abac-643c68a8b71b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:45.868609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.883011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 422/834] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:45.892693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.905367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:45.906132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:45.906509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:45.906861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:45.907794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:45.908262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:45.909750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:45.924261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 413/835] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:45.925642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:45.958120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.008510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989c0ed-a258-4e6c-b7e7-9af7aaa55a69 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.050637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.051723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.052214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.052757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.053799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:46.054317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.056049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.060151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a959b4-99cf-4ba9-a45d-a6866afe2998 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.062926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 423/836] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:46.105629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.106831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.107323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.107879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.117580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.121625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.123215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:46.142658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:46.143635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:46.145530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:46.145530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:46.145530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:46.145530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:46.148827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 414/837] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:46.150873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.265033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5336-eaae-4401-93df-cd456d343860 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.286770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.301608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.302359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.302638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.302910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.303673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:46.303997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.305467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.318657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 424/838] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:46.324812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.428697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67af541-5e35-413e-ad3b-22ddd00d4059 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.463264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.464063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.464342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.464613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.472360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.473876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-48a0d222-81a1-4c12-8221-d1c63c57ec12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:46.489113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:46.490065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:39:46.491018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:46.497992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 415/839] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:46.499586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.589196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e9d-ea27-409f-8011-39b5cf3bbfda None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.589386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e9d-ea27-409f-8011-39b5cf3bbfda None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.589669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e9d-ea27-409f-8011-39b5cf3bbfda None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.591306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 416/840] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:46.596048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.596338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.596618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.601453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93703-e2fa-4a6e-839b-09d919e5c06f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.614918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:46.616346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:46.642796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.643477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.643756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.644027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.645545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:46.645812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.647221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.666745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 425/841] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:46.671987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.672206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.706891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 417/842] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:46.725476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.729904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.805464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f00c1-d501-46fe-9c02-5065550f0ab0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.853512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.854099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.854386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.854662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.854992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def28407-d355-4cca-a5b3-1414c11eb78b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:46.907667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:46.908925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:46.909446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:46.909941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:46.910908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.912500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:46.924945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:46.926591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:46.927530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:46.930372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 418/843] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:46.936171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:46.950171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:46.951626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:46.980469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:46.996030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.052835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad434-d71d-4f4a-8892-7c2dd8b838f7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.064843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 426/844] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:39:47.070867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.095216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.096294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.096815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.097297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.098447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:47.098958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.100634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.106285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 419/845] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:47.116718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.191218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292040-542e-4cee-bbe7-6270cc0ce848 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.217950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188145-7e37-44f8-95aa-226ee29bf5b6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.221061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.228945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.229755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.236879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.236879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.237757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.242002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.243434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.252664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.253483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.253758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.254476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.255149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:47.255669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.257491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fae07-f5b1-4f07-909a-cd2440da75bd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-d9e3cb8c-77b8-4afb-bbac-66885cca8d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:47.261502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:47.262375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:47.263315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:47.263315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:47.263315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:47.263315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:47.267536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 427/846] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:47.268807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf238d-8dac-43ec-af6e-75ac3cb77d53 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.269100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf238d-8dac-43ec-af6e-75ac3cb77d53 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.269411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf238d-8dac-43ec-af6e-75ac3cb77d53 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.272828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 428/847] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:47.272828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf238d-8dac-43ec-af6e-75ac3cb77d53 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.273096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 420/848] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:47.278246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.278541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.278821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.304530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:47.306732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:47.394615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf238d-8dac-43ec-af6e-75ac3cb77d53 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.412821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 421/849] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:47.438697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.447374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.448287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.448576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.448883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.449614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:47.449924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.451294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.464892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 429/850] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:47.470675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.551231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.558167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.563132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ef1f1-7850-47f0-9c1f-0ccac0d2ca0e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.586492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b126-b2fc-48ee-a608-3c56cecdf94b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.609280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.610977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.611745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.612235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.628032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.628907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.629268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.629553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.629986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:47.637082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.638667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:47.640023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:47.641026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:39:47.641874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:47.642552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 422/851] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:47.650169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:47.661820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:47.662762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:47.663737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:47.667897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 430/852] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:47.668944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.766544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5542a-a13b-46f5-89dd-869e4c7923d7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.774052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bf367-80e3-4e89-aeeb-ee00e0217bd3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.785835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.806727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.808003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.808692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.809281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.809729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.810400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.810696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.810989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:47.811315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:47.811759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:47.812073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.812179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:47.813531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.814109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:47.829160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 423/853] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:47.831114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.833049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 431/854] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:47.834511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:47.865097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:47.954048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4c92-afba-40b7-a06b-6156621354a9 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.958266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef05b-550f-43b5-8903-7e5f8d0ca5ea None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:47.994656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:47.995497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:47.995782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:47.996055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.001427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.002102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.002390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.002669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.004684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=6e7088e558ef4e778441a295dbf23500) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:48.004950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.006924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.008281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.011880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.020713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 432/855] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/role_assignments?user.id=6e7088e558ef4e778441a295dbf23500&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:48.036731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:48.037727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:48.038677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:48.038677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:48.038677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:48.038677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:48.041170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 424/856] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:48.047321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.089372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.168185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e0d04-6830-4d2a-a351-e7d0bbcfc675 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.206049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.207136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.207743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.208186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.209095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:48.209556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.211080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd800d6-1f7a-41df-a662-f1ad60721dee None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.224832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 433/857] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:48.230385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.299952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d27d-56c5-402e-abae-3c2fadec6509 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.300287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d27d-56c5-402e-abae-3c2fadec6509 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.300517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d27d-56c5-402e-abae-3c2fadec6509 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.306429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 434/858] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:48.306788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.307993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.308288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.308573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.326996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:48.328596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:48.343567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e5de-e36f-4be6-bc40-22125021f0ad None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.378948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.379785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.380071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.380348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.388324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.389830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:48.405409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:48.406423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:48.407368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 425/859] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:48.409648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 435/860] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:48.417685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.434876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.465326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.522993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7f01-5de1-456f-b597-f2c42c3d2fed None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.545822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db434-7864-450c-854c-b10f8c0b3b7e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.553709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.558952 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.559986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.559986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.560281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.561219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:48.561535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.563083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.582891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 426/861] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:48.588092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.588796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.589785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.590229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.591550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.592618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.594236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:48.607787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:48.609152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:48.609995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:48.612968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 436/862] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:48.619130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.706457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe844-f992-4ced-8f55-b50791eb3422 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.735305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.742886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.743807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.744259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.744732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.750095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b38b45-40a8-459d-83b4-77e31bd4b271 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.792303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.793398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.793897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.794385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.795318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:48.795865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.797498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.803373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 437/863] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:48.808782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:48.827526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:48.840586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.842781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.929492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aab2b-38a2-4cb6-8ee1-c4cfb668b6aa None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:48.967307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:48.968418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:48.968993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:48.969501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:48.970549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:48.971221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:48.973583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:48.983708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 427/864] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:39:48.984308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 438/865] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:48.986602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.091549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:49.106980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee423a99-d90c-4ad3-a6d7-bfead5f3a24a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.153313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.154515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.155029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.155515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.166911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.168810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:49.188149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:49.189124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:49.190060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:49.190060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:49.190060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:49.190060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:49.192978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 428/866] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:49.201843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.223495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:49.312411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a8a1-ff4f-4ac0-b39a-94c55797de02 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.348250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.348958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.349247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.349532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.350259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:49.350570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.351942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d238-2064-46ec-af26-912ef918b1d7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.365723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 439/867] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:49.371089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.375018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed900-4ed9-4b09-a0d9-6d37c82f4fa3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.375313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed900-4ed9-4b09-a0d9-6d37c82f4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.375592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed900-4ed9-4b09-a0d9-6d37c82f4fa3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.377403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 440/868] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:49.384659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.385050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.385399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.408103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:49.409702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:49.487425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ddb2-438b-4141-8c73-c44a47c4125c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.500711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 441/869] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:49.523393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.533938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:49.541100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.542232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.542703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.543123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.550497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.552727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:49.567419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:49.568465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:49.569396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:49.571812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 429/870] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:49.577536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.581302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:49.645883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35edf-0a7e-40fe-a59f-b38e1ad0576c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.684203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.685331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.685823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.686375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.687289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.688939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2fb05-99fd-415c-8f47-b2d915505d01 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.705872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14ac6-a54b-448d-abda-7c4b47d1d80e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.743008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.743738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.744027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.744303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.745141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:49.745465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.746937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.760821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 430/871] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:49.766007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:49.785044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 442/872] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:39:49 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:39:49.846043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:49.890862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50acc-daf3-4403-8930-56ba7a2ca0a5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:49.936769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:49.937816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:49.938308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:49.938812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:49.939849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=158d55f449004896bd0abccbadbc48e5) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:49.940367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:49.942934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cecae-7826-4d5b-8107-ca830855787c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:49.949939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 431/873] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:49 2022] GET /identity/v3/role_assignments?user.id=158d55f449004896bd0abccbadbc48e5&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:50.157448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2700c-9b53-449f-b202-1e86df68f8c3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:50.157762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2700c-9b53-449f-b202-1e86df68f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:50.157948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2700c-9b53-449f-b202-1e86df68f8c3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:50.159342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 443/874] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:50.166281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:50.166593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:50.166860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:50.185907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:50.187139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:50.380780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 432/875] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:50.398020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2700c-9b53-449f-b202-1e86df68f8c3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:50.466018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:50.503374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2700c-9b53-449f-b202-1e86df68f8c3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:50.539156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:50.539978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:50.540264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:50.540540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:50.541231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:50.542598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:50.554743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:50.555959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:50.557103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:50.562050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 444/876] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:50.563417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:50.617901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:50.666740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eae1c-8f60-449a-be01-b30804e2ec7c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:50.700187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:50.700892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:50.701173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:50.701454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:50.702176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:50.702485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:50.703858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c7451-6790-4316-8b0f-f7ceac76b31c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:50.713792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 433/877] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:50.715170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:50.821325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c213f-7c55-4ca4-bc83-de770f4b31a8 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:50.850913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:50.859985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:50.860687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:50.860981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:50.861261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:50.862037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:50.862442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:50.864413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27c05a-ad86-4232-876f-170ec39a3324 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:50.872794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 445/878] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:51.143383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70703791-1e65-42fa-8196-41e2f6395a56 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:51.143891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70703791-1e65-42fa-8196-41e2f6395a56 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:51.143891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70703791-1e65-42fa-8196-41e2f6395a56 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:51.146011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 434/879] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:51.151072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db21f6-8bc3-484b-ad92-3bba057d7ffc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:51.151370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db21f6-8bc3-484b-ad92-3bba057d7ffc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:51.151651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db21f6-8bc3-484b-ad92-3bba057d7ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:51.169646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f2db21f6-8bc3-484b-ad92-3bba057d7ffc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:51.170828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f2db21f6-8bc3-484b-ad92-3bba057d7ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:51.242514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 446/880] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:51.266005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70703791-1e65-42fa-8196-41e2f6395a56 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:51.375591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70703791-1e65-42fa-8196-41e2f6395a56 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:51.399327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:51.414915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:51.421316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:51.421316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:51.421316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:51.421316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:51.421316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d191-673d-45bd-8a8a-2e5418bc59b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:51.502220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 435/881] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:39:51 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:51.971787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c2c3-6bc5-4967-972c-002f801bf22d None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:51.972440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c2c3-6bc5-4967-972c-002f801bf22d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:51.972440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c2c3-6bc5-4967-972c-002f801bf22d None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:51.974075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 447/882] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:51.979945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041454-09e1-47f5-ad8c-ff209f206d32 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:51.980291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041454-09e1-47f5-ad8c-ff209f206d32 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:51.980661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041454-09e1-47f5-ad8c-ff209f206d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.005741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c2041454-09e1-47f5-ad8c-ff209f206d32 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:52.006987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2041454-09e1-47f5-ad8c-ff209f206d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:52.095734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 436/883] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:52.118775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7c2c3-6bc5-4967-972c-002f801bf22d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.221262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15587-3dc1-4cb5-ad95-aa76921b21bc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.221847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15587-3dc1-4cb5-ad95-aa76921b21bc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.221847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15587-3dc1-4cb5-ad95-aa76921b21bc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.224063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 437/884] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:52.224321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7c2c3-6bc5-4967-972c-002f801bf22d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.229018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.229310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.229590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.247463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:52.248659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:52.256169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.268639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.268639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.268639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.268639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.269007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.269007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:52.288477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:52.293945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:52.295389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 448/885] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:52.296242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.332597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 438/886] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:52.352112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.385930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.402320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fa38-5b9a-4d4f-a8b1-62d5cf10d7ec None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.438555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.439279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.439519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.439800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.440519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:52.440859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.442533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.447865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 449/887] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:52.453698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.467145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c312f-c453-41c0-83b5-1158db95d915 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.505488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.506609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.507084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.507557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.509431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.519087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:52.528607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:52.529678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:39:52.530512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:52.538627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 439/888] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:52.540864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.560798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69466a-de19-46b9-b088-e0d19f2966fe None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.595901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.596578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.596896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.597178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.598513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:52.598785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.600109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.610345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 450/889] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:52.611587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.645666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.655640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992263c-c380-4df3-9362-9ac2c5400289 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.696782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.697873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.698394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.698894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.699849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:52.700351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.701940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.716587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 440/890] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:52.717835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.721053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e03bf9-828c-4f1a-af8c-4c949350fce1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.738679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.757407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.758622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.758622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.758622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.759327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] RBAC: Adding query filter params (interface=public, service_id=fd22031b68fc471cb8f458bd99b82f5b, region_id=RegionOne) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:52.759815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.761222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.771577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 451/891] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/endpoints?service_id=fd22031b68fc471cb8f458bd99b82f5b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:52.772431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.830717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df63fa-5a0c-4857-a4b7-d245029b8e8c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.867926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.869126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.869623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.870105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.878187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17b46-2a02-4043-90fc-57d9d9203685 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:52.883185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.884911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:52.903011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:52.903946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:52.904849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:52.904849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:52.904849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:52.904849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:52.912221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 441/892] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:52.913349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:52.915741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:52.916425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.916733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.917016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.917709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:52.919315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773246-da90-40c8-9738-8d59eb597c40 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:52.924293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:52.932842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 452/893] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:39:52.982344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588be43-fb90-4947-a677-b0b9b5407e2b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.983031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588be43-fb90-4947-a677-b0b9b5407e2b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.983031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588be43-fb90-4947-a677-b0b9b5407e2b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:52.989541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 453/894] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:52.991323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:52.992076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:52.992076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.010588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:53.011914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:53.040550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d777e5-0fac-4600-9cc4-04c6403b3e0a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.059562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.079974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.080809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.081180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.081540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.082711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:53.083177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.084699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.100026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 442/895] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:53.108750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.108917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 454/896] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:53.132801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.190999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.227817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44401f40-779a-43ce-bac7-c67b4c93467a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.264916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aeb16-258a-42d4-9548-e0e54f65c16a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.265095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.265675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.265965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.266249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.275003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.276500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:53.293760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:53.294783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:53.296341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 443/897] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:53.300386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.312471 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.313379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.313587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.313883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.314637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.316813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.401026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 455/898] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:39:53 2022] POST /identity/v3/services => generated 241 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:39:53.413677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518b3d-0ae9-4349-806b-f79c72bf8d65 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.444681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.460153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.460871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.461157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.461432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.462299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:53.462612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.464095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dce57f-2d1a-4763-bbfe-52088210e094 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.485766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 444/899] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:53.491755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.538645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.613654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f19a-d7fa-4d4c-a5fd-2c400c63f62a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.629234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c3fb-8121-4c7a-a880-d09a346c3368 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.629553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c3fb-8121-4c7a-a880-d09a346c3368 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.629829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c3fb-8121-4c7a-a880-d09a346c3368 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.631190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 445/900] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:39:53.636195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.636479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.636799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.652715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.653072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:53.653519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.653870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.654209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.654324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:53.727501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.729007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.733240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 446/901] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:53.757541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.783158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.844472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 456/902] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:39:53.850494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.859872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6dca-cf38-41c7-880b-aa8ccb8d7e23 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:53.872581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:53.900516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:53.901373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:53.901759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:53.902042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:53.902810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:53.904186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:53.917691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:53.918872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:53.919844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:53.924129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 447/903] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:53.925088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:53.978336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6f9e-890f-4d54-95e5-e315dc38cda0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.024931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.025748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.026028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.026303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.028396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.035710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad9db9-b782-4580-b447-019fafdebdb9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.037767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.039218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:54.057463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:54.058445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:54.059356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:54.059356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:54.059356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:54.059356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:54.059887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 457/904] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:54.064506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.077574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.078247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.078531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.078809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.079983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.080293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.082926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.091892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 448/905] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:54.097397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.158049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.202552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332bbf4-2b69-4d6b-9f94-6fe86357a426 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.220943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714f84f-2543-4b1c-a1cc-1127757e31f2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.241629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.242662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.243101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.243523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.244395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.244886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.246595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.258061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.258853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.264426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.264426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.264426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.264426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.264820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 458/906] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:54.266085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.267989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.277605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 449/907] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:54.278710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.332378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.403660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5721a-3756-487c-a2a1-8ce69fe38a3b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.409049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c54a-7e6b-4ecd-8ab7-7afc15f67d4f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.410737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.450873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.451961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.452439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.452851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.456543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.457434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.457863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.458329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.460534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] RBAC: Adding query filter params (interface=public, service_id=74dbe401102f4d5dbaa19010f42a1482, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.461043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.461157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.462646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.462825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.472858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 450/908] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/endpoints?service_id=74dbe401102f4d5dbaa19010f42a1482&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:54.474629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:54.483079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:54.484459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:54.485662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:54.492299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 459/909] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:54.493565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.595129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aef67a-ec55-40d6-af91-8a61363d3737 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.609306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50290-2627-4d08-890e-de8fe375bb60 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.618521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.635332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.636404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.636930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.637426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.638334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.639907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.647152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 451/910] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:39:54.653642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.654880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.655376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.655864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.656967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.657516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.659283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a4e97-6b0d-4ba0-a556-244d9c7252cd None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.674068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 460/911] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:54.680566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:54.721084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:54.797892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d2328-a0bc-421a-b43a-3ca35bdf1c68 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:54.832496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:54.833320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:54.833705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:54.834085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:54.835032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] RBAC: Adding query filter params (role.id=5c8bc83de6b54371a32313971b0b1dcc, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=158d55f449004896bd0abccbadbc48e5) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:54.835447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:54.837005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0a12e-73f1-4039-9e5f-f0fcac0b8bb9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:54.842892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 452/912] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:39:54 2022] GET /identity/v3/role_assignments?user.id=158d55f449004896bd0abccbadbc48e5&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=5c8bc83de6b54371a32313971b0b1dcc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:55.136413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289731-7e24-4ae0-800c-c71e20015e36 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.136956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289731-7e24-4ae0-800c-c71e20015e36 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.137052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289731-7e24-4ae0-800c-c71e20015e36 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.138524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 461/913] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:55.147146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528aad9-ef5f-4992-81dd-12db3f77adec None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.147450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528aad9-ef5f-4992-81dd-12db3f77adec None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.147716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528aad9-ef5f-4992-81dd-12db3f77adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.185003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a528aad9-ef5f-4992-81dd-12db3f77adec None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:55.186256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a528aad9-ef5f-4992-81dd-12db3f77adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:55.271086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 453/914] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:55.324272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d289731-7e24-4ae0-800c-c71e20015e36 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:55.532600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d289731-7e24-4ae0-800c-c71e20015e36 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:55.573943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:55.574819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.575055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.575336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.576333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:55.579717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282c9d-7b0c-4550-8ab3-e619bc4f3c3e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.580052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282c9d-7b0c-4550-8ab3-e619bc4f3c3e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.580391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282c9d-7b0c-4550-8ab3-e619bc4f3c3e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.582696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 454/915] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:55.583205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:55.587885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.588172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.588455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.614355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:55.616007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:55.616994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:39:55.617839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:55.618573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:55.620701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 462/916] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:55.625844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:55.651823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:55.706122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:55.724719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 455/917] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:55.746581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:55.819314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47d04-e517-4e17-b98c-f9aace008af7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:55.861237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:55.861831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.862117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.862395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.865088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:55.865415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:55.866849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:55.875899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 463/918] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:55.882580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:55.885591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5211f0-98a9-4f13-976f-023eed56daac None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:55.936918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:55.938016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:55.938303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:55.938580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:55.939249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:55.941538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:55.959246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:55.960281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:55.966476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 456/919] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:55.967283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:55.988696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:56.005008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:56.012217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614af06-ed73-49a9-8b96-cd0c4bb2c65e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.056942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.057624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.057911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.058188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.058962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:56.059268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.061225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.068859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 464/920] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 5 12:39:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:56.075236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:56.092126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959761f-0a79-4fe4-8ee9-a77de2296102 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.134166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.134762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.135441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.135726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.136757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:56.137068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.139135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.146070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 457/921] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:56.151047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:56.211163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be51e7-2658-4b13-83f8-ecae263d68c1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.260381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.261670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.262136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.262841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.264076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:56.265009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.267183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.285560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22289-1582-475d-b00c-fd23983ef725 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.319571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.320293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.320580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.320904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.321622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:56.321928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.323293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.328515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 458/922] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:56.334621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:56.377385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 465/923] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:39:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:39:56.446149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1ff1-3822-4559-83eb-2f91af3f856e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.490767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.491559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.491849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.492128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.492980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] RBAC: Adding query filter params (interface=public, service_id=1d533b9c60204692a08efcaebac2f197, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:56.493299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.494710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fc7bd-e5e4-40fa-9cbb-04fb88aacce9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.505149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 459/924] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:39:56 2022] GET /identity/v3/endpoints?service_id=1d533b9c60204692a08efcaebac2f197&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:56.507664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:56.525922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:56.623090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dc4cb-ca7e-4e4b-8ac1-d7aaad0ea449 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:56.657972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:56.658650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.658940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.659216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.660115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:56.661672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e515402-f1f3-42ee-aa52-eb2f9e536e37 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:56.668167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 466/925] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:39:56 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:39:56.859225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d074a3-42be-4501-bcb1-fcf4b82cd8ee None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.859622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d074a3-42be-4501-bcb1-fcf4b82cd8ee None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.859799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d074a3-42be-4501-bcb1-fcf4b82cd8ee None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.861486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 460/926] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:56.867328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edf90-6377-457d-b850-9307953f1038 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:56.867628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edf90-6377-457d-b850-9307953f1038 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:56.867912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edf90-6377-457d-b850-9307953f1038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:56.885962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-602edf90-6377-457d-b850-9307953f1038 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:56.887169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-602edf90-6377-457d-b850-9307953f1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:56.960345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 467/927] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:56.984083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d074a3-42be-4501-bcb1-fcf4b82cd8ee None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:56.995588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.045314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae946d-5fd1-480d-ba5c-8c78b4b05e82 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.045622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae946d-5fd1-480d-ba5c-8c78b4b05e82 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.045878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae946d-5fd1-480d-ba5c-8c78b4b05e82 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.047507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 468/928] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:57.053131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.053421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.053701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.070832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:57.072047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:57.074405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.109880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d074a3-42be-4501-bcb1-fcf4b82cd8ee None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.152318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.152965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 469/929] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:57.153176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.153562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.153840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.154501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.155880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.168880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:57.169322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:57.170245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:57.171448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 461/930] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 5 12:39:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:57.178845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.265179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.295517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d3c1-cc1f-4627-863e-c21c34eedf34 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.310287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185f53b-c3e9-46a8-9ce2-8a7412c7a37f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.340436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.341303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.341591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.342077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.352009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.356250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:39:57.358759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.359664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.360247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.360853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.361886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:57.362402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.364874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:39:57.365952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:57.366863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:57.368247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 470/931] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:39:57.373117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.378180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 462/932] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:39:57.380650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.488937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baea13-f2e3-4cca-92f0-3a8f8cb05025 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.522355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64379-4f3c-4840-85c9-4f873bffc0bc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.524730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.526091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.526091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.526091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.526791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:57.527105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.528600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.537567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 471/933] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:57.548693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.565605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.567231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.567606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.568128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.569100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:57.569418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.570791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.572139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.582982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 463/934] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:57.584045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.622422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.674325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff7a2-f622-4784-9ec3-143f2b7c7bdc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.703145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025553b-cd36-45da-95a6-7b8e7111a1f1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.714047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.715039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.715393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.715756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.727617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.729368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.740540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.741443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.741899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.742345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.743254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.744851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:57.750147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:57.751260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:57.752532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:57.752532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:57.752532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:57.752532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:57.756645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 472/935] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:57.757670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:57.848847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 464/936] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:39:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:39:57.872941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c742c-008b-431d-8101-eda4252e89c8 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:57.888828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:57.920466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:57.921244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:57.921542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:57.921823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:57.922557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:57.922868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:57.924263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:57.943979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 473/937] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:57.945352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.032070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:58.083072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec948d-c179-4de2-8bbf-242ef5a71f6e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:58.128175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:58.130175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.130678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.131366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.142602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:58.144873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:39:58.163436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:58.164697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:39:58.165908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:58.168193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 465/938] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:39:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:58.174436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.303242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572979b-b898-47e8-8956-927482b1c376 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:58.349448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:58.350527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.351002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.351474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.352514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:58.353021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:58.354762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:58.382084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 474/939] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:39:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:58.386509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.509767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c682b0-cbea-4704-82a1-8d3c48231067 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:58.524299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:58.546449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:58.547317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.547601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.547874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.561951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:58.563506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-eef0ed80-78d6-46f9-ae41-5fe275751b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:39:58.582294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:58.584448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:58.586125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:39:58.586125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:39:58.586125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:39:58.586125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:58.586125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 466/940] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:58.593611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.629325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:58.717081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca9dad-548b-482c-95a1-ecfc33b18156 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:58.734721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49545f6-fae6-47dc-bfd7-a3ac857de623 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.735057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49545f6-fae6-47dc-bfd7-a3ac857de623 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.735274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49545f6-fae6-47dc-bfd7-a3ac857de623 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.736776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 467/941] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:58.743825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc973-feb6-4786-a06c-29ccab531469 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.744989 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc973-feb6-4786-a06c-29ccab531469 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.745519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc973-feb6-4786-a06c-29ccab531469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.761629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:58.762319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.762607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.762888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.763628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:58.763939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:58.765406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:58.778310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-35ebc973-feb6-4786-a06c-29ccab531469 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:58.779757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 475/942] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:58.780490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-35ebc973-feb6-4786-a06c-29ccab531469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:58.787070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.865309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 468/943] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:39:58.874331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee66f7-716d-43e2-81cb-6b5c3350d2ee None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.874627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee66f7-716d-43e2-81cb-6b5c3350d2ee None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.874907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee66f7-716d-43e2-81cb-6b5c3350d2ee None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.876423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 469/944] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:39:58.882481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.882770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.883054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.900242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:58.901371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:39:58.902591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:39:58.915365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4371e-d8f7-4279-8053-087742893db7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:58.951943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:58.952768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:58.953056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:58.953362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:58.960438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:58.961938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:58.975949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 470/945] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:39:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:58.976761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:58.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:58.978565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:58.981504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:58.982693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 476/946] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:58.983785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.025828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.097072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c884b3-f06d-48f5-b944-08dc5523a70e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.113878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a60d1-0eef-4a4f-b3c4-d2f0d7ef81a9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.143070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.143860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.144150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.145071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.145888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:59.146200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.147692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.151783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.152452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.152769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.153052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.153763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.155257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.156715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING keystone.server.flask.common [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 12:39:59.165787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 477/947] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:59.165787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.184413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.225660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.sql.core [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:39:59.225660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 12:39:59.225660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [parameters: {'id': 'a03fdb62102148af858532a04216a4bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 12:39:59.225660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a03fdb62102148af858532a04216a4bb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a03fdb62102148af858532a04216a4bb. Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:39:59.244399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result.read() Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 12:39:59.245320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application yield resource Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise self.value Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application session.commit() Jul 05 12:39:59.246273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:39:59.247800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:39:59.248758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result.read() Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:39:59.249558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [parameters: {'id': 'a03fdb62102148af858532a04216a4bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.251134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:59.252123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a03fdb62102148af858532a04216a4bb. Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 471/948] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Jul 5 12:39:58 2022] POST /identity/v3/projects => generated 262 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:59.253293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.291325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627362-9f7c-434e-84ed-c48267066c8a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.327599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.328414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.328714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.328990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.329646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.331035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:59.344363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:59.345503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:39:59.346437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:59.347772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.347850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 478/949] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:39:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:59.348610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.372166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e44f-938a-4eaf-a15d-aaddaf89a7b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.407572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.408625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.408945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.409528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/158d55f449004896bd0abccbadbc48e5/roles/5c8bc83de6b54371a32313971b0b1dcc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.412345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=158d55f449004896bd0abccbadbc48e5, role_id=5c8bc83de6b54371a32313971b0b1dcc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.414017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.420827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.452119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe1c6-4511-409f-87d8-942458398d86 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.473535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 472/950] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:39:59 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/158d55f449004896bd0abccbadbc48e5/roles/5c8bc83de6b54371a32313971b0b1dcc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:39:59.474834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.503324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.504131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.504381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.504665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.512900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.514741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:39:59.533080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:39:59.534288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:39:59.536179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:39:59.540313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 479/951] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:39:59.541387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.622846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b39a-a052-4174-a5ef-5b6cb929d219 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.661325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c442dc-1e6e-4252-ad6b-d57b93d3f17b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.669379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.670228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.670620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.670998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.672362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:59.673585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.674715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.692728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 473/952] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:59.692728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.701806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.704133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:39:59.710013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.710752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.711041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.711320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.712098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:59.712408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.713883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.734320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 480/953] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:39:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:59.807864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f37eb-cc9c-4e70-bf9f-f7b272f6bd6d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:39:59.847964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:39:59.848860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:39:59.849143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:39:59.849422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:39:59.850157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:39:59.850464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:39:59.851866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d458-312f-4983-bc87-56ce587e4972 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:39:59.857937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 474/954] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:39:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:39:59.864005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:39:59.978481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868fd0-5e74-4030-8517-ad0e2fbcbbb4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:00.022553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:00.022553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.022553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.022553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.023022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:00.024210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:00.074778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f70c2-020f-4470-b225-29e7be19c0f8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.075080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f70c2-020f-4470-b225-29e7be19c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.075429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f70c2-020f-4470-b225-29e7be19c0f8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.077185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 475/955] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:00.082212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.082573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.086679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.101355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:00.102874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:00.112629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 481/956] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:39:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:00.190949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:00.203128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 476/957] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:00.225868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:00.279770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:00.339577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac66e-322f-496a-93d4-78b275cc7f0a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:00.375784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:00.376605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.376921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.377209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.377879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:00.379543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:00.393460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:00.395430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:00.396503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 482/958] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:00.401347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:00.510152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de247-fc6a-43eb-8686-07d61e537e61 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:00.547779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:00.548866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.549383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.549866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.550826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:00.551381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:00.553030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3741d-2562-4dfa-92c0-1d72dfe47330 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:00.558531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 477/959] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:00.566114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:00.671603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4706c77-5307-449a-82ed-c6b31da169f7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:00.684467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:00.709123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:00.709801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:00.710115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:00.710371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:00.711088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:00.711399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:00.712801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd267-90a6-49df-b157-d3fea0bf9df6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:00.717698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 483/960] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:01.631386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f936-0d25-4412-940c-66a83e28ffc4 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:01.631911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f936-0d25-4412-940c-66a83e28ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:01.632025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f936-0d25-4412-940c-66a83e28ffc4 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:01.633678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 478/961] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:01.638943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:01.639356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:01.639560 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:01.657332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:01.658588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:01.732803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 484/962] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:01.756148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64f936-0d25-4412-940c-66a83e28ffc4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:01.820242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:01.865798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64f936-0d25-4412-940c-66a83e28ffc4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:01.904985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:01.905725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:01.906007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:01.906281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:01.917585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c2b2e9f4-308d-42fc-ae96-8af7c443cdcd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:01.925998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:01.926953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:01.927777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 479/963] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:40:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:01.934520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:01.967749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa441d-193d-4b41-8e48-ae52b0257550 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:01.968077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa441d-193d-4b41-8e48-ae52b0257550 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:01.968319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa441d-193d-4b41-8e48-ae52b0257550 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:01.970162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 480/964] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:01.975852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:01.976145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:01.976833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:01.993653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:01.994853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:02.057561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64ddb-3b37-45da-945e-fd1f483b6f13 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.060143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.077576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 481/965] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:02.095312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.096006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.096303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.096587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.097933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:02.098255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.099645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.102382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.113736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 485/966] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:40:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:02.119773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.162580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.221895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3727f-556d-41d7-8fad-1990a6e29bf1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.250103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb4d06-e9dd-4a05-8385-28395caa8123 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.266468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.267399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.267698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.267980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.269244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.270637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.290589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.291399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.292912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.292912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.303178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.304625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.311955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.sql.core [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:40:02.311955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 12:40:02.311955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [parameters: {'user_id': 'a6d89ac8d6c545dd955c8ead2fc58237', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 12:40:02.311955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9a426154-649d-41b3-9ceb-112e5dca8d72 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result.read() Jul 05 12:40:02.319863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:40:02.322443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application yield resource Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise self.value Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application session.commit() Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:40:02.323463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:40:02.324345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:40:02.326152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application result.read() Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:40:02.327195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a6d89ac8d6c545dd955c8ead2fc58237', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:02.328790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 12:40:02.329628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 482/967] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 5 12:40:02 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650da4a-51e6-429b-ab39-92bb170f206d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650da4a-51e6-429b-ab39-92bb170f206d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.330539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650da4a-51e6-429b-ab39-92bb170f206d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:02.331220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:02.332240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:02.333181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:02.333181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:02.333181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:02.333181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.333181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 486/968] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:02.333457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 483/969] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:02.333534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.334964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667821-711e-4045-b0be-475b759beaff None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.335257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667821-711e-4045-b0be-475b759beaff None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.335584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667821-711e-4045-b0be-475b759beaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.353478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.354725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4b667821-711e-4045-b0be-475b759beaff None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:02.356336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4b667821-711e-4045-b0be-475b759beaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:02.429245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 484/970] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:02.437625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667821-711e-4045-b0be-475b759beaff None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.442502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0b52-6f02-4141-83ba-2f0b76e58706 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.482995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.484422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.484737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.485022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.485654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.494805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.499044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:40:02.511657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:02.512613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.513597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 487/971] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:02.514219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.553912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667821-711e-4045-b0be-475b759beaff None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.590240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.590913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.591202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.591479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.592215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:02.592529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.594068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.601793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.606475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 485/972] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:02.611790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.626346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4041f5-e733-43b7-a45d-44c171050071 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.664970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.665796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.666078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.666351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.667010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.668607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:02.683313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:02.684341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:02.685576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.690287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 488/973] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:02.690287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.715201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51196fb3-c226-4067-812a-93fba0766930 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.716852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.749316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.750000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.750289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.750912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.751889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:02.752510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.754757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.788990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 486/974] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:02.789812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.810699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a253-f02d-4591-9fa4-eea6ec9d2bc0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.851326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.852185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.852796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.852907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.862544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.864711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4b593977-eb58-406c-8232-64d23f4db426 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:40:02.882170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:02.883212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:02.884172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 489/975] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:02.885424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51f4b2-daee-4aa2-9865-dec8492019bc None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.885424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51f4b2-daee-4aa2-9865-dec8492019bc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.885424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51f4b2-daee-4aa2-9865-dec8492019bc None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.886757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 490/976] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:02.891612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51f4b2-daee-4aa2-9865-dec8492019bc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:02.894616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:02.924457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4804af-0af3-49bc-8dc2-951e53b93175 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:02.970567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:02.971390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.971679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.972470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:02.973901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:02.974497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:02.976079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08288-39a2-41ee-96fe-53719eae6723 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:02.981467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 487/977] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:02.986447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:02.986447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:02.986447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.000480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:03.001769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:03.015119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51f4b2-daee-4aa2-9865-dec8492019bc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.021875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.057261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.057993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.058284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.058573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.059514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:03.059832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.061299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.078222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 488/978] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:03.079063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.083840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 491/979] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 5 12:40:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:03.084521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.149936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.181342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f557f-6626-4a8b-bdc8-5f92ee649511 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.191468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943c131-4a46-4337-9c39-85756e82a06b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.217034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.217702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.217989 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.218273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.218986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:03.219299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.220765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.225508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.225961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 489/980] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:03.226190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.226478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.226716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.226813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.247644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.295529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.297007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.326874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b1d6-a84a-4a09-8921-6d99bf706a5b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.353685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.361398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.362240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.362911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.363191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.366245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.366245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.394509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 492/981] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:03.395323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.496208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345925-32e8-4a78-be7f-55bc49e4d354 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.506701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 490/982] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:03 2022] POST /identity/v3/services => generated 242 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:03.507530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.544572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.545303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.545599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.545929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.546946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] RBAC: Adding query filter params (interface=admin, service_id=1d533b9c60204692a08efcaebac2f197, region_id=RegionOne) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:03.548162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.549615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.557632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 493/983] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/endpoints?service_id=1d533b9c60204692a08efcaebac2f197&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:03.563159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.589362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.602233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.625780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78917-db9a-4a11-81be-20036df30c59 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.665605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.666424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.666709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.666987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.678634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.680037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.685476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bd849-c987-4083-b65b-4a110ae4714a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:03.703360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:03.704295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:03.705463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:03.705463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:03.705463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:03.705463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:03.705463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 491/984] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:03.712004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.722343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.723205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.723496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.723774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.724467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.725920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.732386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 494/985] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:40:03.830740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff0757-bc89-4b64-a8f0-dad974df0773 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:03.862068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.869074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:03.869947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:03.870197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:03.870477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:03.871241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:03.871554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:03.872987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:03.892398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 492/986] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:03.893731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:03.981251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:03.998495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728f86-d348-42f5-bd23-acedaa35441a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:04.042363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:04.043174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:04.043458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:04.043736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:04.051271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:04.052758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:40:04.067458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:04.068347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:04.069596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:04.073549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 495/987] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:04.074759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:04.174927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c709d7-2151-4dab-b8d6-280fb7fd2a7c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:04.211870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:04.212544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:04.212861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:04.213143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:04.213944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:04.214259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:04.215696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c767b-6dac-4f03-883e-d44cdb3cecd3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:04.232109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 493/988] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:04.233693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:04.339031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f85ca-f62b-49dc-b3a5-03876e5b1c8b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:04.373348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:04.374009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:04.374298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:04.374577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:04.375404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] RBAC: Adding query filter params (role.id=5c8bc83de6b54371a32313971b0b1dcc, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=158d55f449004896bd0abccbadbc48e5) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:04.375716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:04.377190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff8ba-02d5-42e5-ab40-027097df71ab None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:04.392715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 496/989] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:04 2022] GET /identity/v3/role_assignments?user.id=158d55f449004896bd0abccbadbc48e5&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=5c8bc83de6b54371a32313971b0b1dcc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:05.567528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66919c-57a8-4b19-8dac-e56820a5476b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:05.568050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66919c-57a8-4b19-8dac-e56820a5476b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:05.568159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66919c-57a8-4b19-8dac-e56820a5476b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:05.574396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 494/990] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:05.579817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f94a-1ea6-406d-b6d9-088268ccb4d9 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:05.580254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f94a-1ea6-406d-b6d9-088268ccb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:05.580442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f94a-1ea6-406d-b6d9-088268ccb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:05.597710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-5ce5f94a-1ea6-406d-b6d9-088268ccb4d9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:05.598930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5ce5f94a-1ea6-406d-b6d9-088268ccb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:05.601076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:05.668794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 497/991] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:05.690281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66919c-57a8-4b19-8dac-e56820a5476b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:05.742342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:05.789798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4bd7-d07c-47c2-9721-3559bd9f90cb None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:05.790127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4bd7-d07c-47c2-9721-3559bd9f90cb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:05.790358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4bd7-d07c-47c2-9721-3559bd9f90cb None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:05.791709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 498/992] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:05.795351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66919c-57a8-4b19-8dac-e56820a5476b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:05.796398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:05.796701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:05.796992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:05.814164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:05.815343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:05.835286 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:05.836053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:05.836343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:05.836635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:05.837438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:05.838821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:05.850614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:05.851598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:05.852442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 495/993] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:05.857649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:05.892042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 499/994] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:05.915621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:05.968173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073b11-dfb6-4871-a9b3-1f4b350a77d3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:05.984049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:05.994136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.006126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.006870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.007202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.007436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.008149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.008523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.009941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.015029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 496/995] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:06.021024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.034128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39d78-d847-4c47-87eb-20cb077067a2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.076122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.077079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.077588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.077761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.078424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.079916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:06.092971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:06.094042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:06.095015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 500/996] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 5 12:40:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:06.100710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.137228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628191b8-7668-4cdb-a2a2-6afc2ca031c2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.173074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.173850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.174141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.174421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.175790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.176104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.177515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.187432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 497/997] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:06.189130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.210251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104d60-4d44-4501-ad4d-f95937ba08f0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.234477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.245686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.252543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.253474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.253901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.254186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.254937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.255254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.256627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.267258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 501/998] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:06.269447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.299543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac03fe-b140-4183-bfc4-23740e8f554f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.337306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.337975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.338259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.338525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.339367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] RBAC: Adding query filter params (interface=public, service_id=01d9f608dc034b469a07abc8d50cd2e1, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.339677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.341065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.351151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 498/999] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/endpoints?service_id=01d9f608dc034b469a07abc8d50cd2e1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:06.352886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.393636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ee275-9d87-4cca-af52-923df2ba41dc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.434125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.434807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.435417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.435702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.436761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.437076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.439001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.450248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 502/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:06.451200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.458834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed425f5-d8f5-481e-9344-267295744fb0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.465796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.495476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.496150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.496436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.496735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.497423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.498796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d025-7dbd-4ce9-bc71-413598b6f7e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.505561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 499/1001] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:40:06.506776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd521-786c-4b95-99bd-be58ad4a4ec9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.507067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd521-786c-4b95-99bd-be58ad4a4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.507349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd521-786c-4b95-99bd-be58ad4a4ec9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.508801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 500/1002] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:06.514264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.514572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.514823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.517296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.535131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:06.537086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:06.563733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426545a-0c86-4ab9-916c-484d793e78cf None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.606072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.608933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.609626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.610146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.611526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.613356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.616880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 501/1003] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:06.640310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.701650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 503/1004] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:40:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:06.750490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.754373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685752cc-1e3f-40a8-b8c9-71798cbcc5a9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.799955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.800999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.801285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.801560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] PATH_INFO: `/v3/services/image` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.802230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.803627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:06.816517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:06.817823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:06.818691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 502/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:06.823957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:06.934065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339b0de-44a6-4b1f-b18c-c352d679845b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:06.953382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:06.966957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:06.967638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:06.967924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:06.968539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:06.968927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] RBAC: Adding query filter params (name=image) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:06.969237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:06.970600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd7b7-b760-4b8f-9271-7d96d9f27283 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:06.975994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 504/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:06.981899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:07.092654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b9972-debc-450a-853e-71ff49261155 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:07.127415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:07.128145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:07.129037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:07.129319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:07.130033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:07.130340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:07.131704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd70d45-ae0f-4d3d-8672-dab66671a5d4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:07.144698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 503/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:08.571340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50ca5-28ab-48b2-8937-7193a463f4b4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:08.571863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50ca5-28ab-48b2-8937-7193a463f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:08.571863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50ca5-28ab-48b2-8937-7193a463f4b4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:08.573400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 505/1008] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:08.578358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ffe44-ed0e-4462-bd59-c179b0fb6a73 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:08.578772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ffe44-ed0e-4462-bd59-c179b0fb6a73 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:08.578983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ffe44-ed0e-4462-bd59-c179b0fb6a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:08.595599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-113ffe44-ed0e-4462-bd59-c179b0fb6a73 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:08.596866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-113ffe44-ed0e-4462-bd59-c179b0fb6a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:08.615006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:08.665207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 504/1009] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:08.688416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50ca5-28ab-48b2-8937-7193a463f4b4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:08.792436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50ca5-28ab-48b2-8937-7193a463f4b4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:08.796859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed114-4a5a-4d5c-b845-b7cbd017d21b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:08.797220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed114-4a5a-4d5c-b845-b7cbd017d21b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:08.797562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed114-4a5a-4d5c-b845-b7cbd017d21b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:08.799010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 505/1010] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:08.804501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:08.804842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:08.805115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:08.822256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:08.823368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:08.834613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:08.835610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:08.836068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:08.836488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:08.837317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:08.838820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:08.851129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:08.852447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:40:08.853356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:08.854083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 506/1011] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:08.860031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:08.896939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 506/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:08.911102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:08.920565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:08.963273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c1022-1930-4d88-97c8-59aab7fe3ca4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:08.999666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.000659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.001210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.001675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.002603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:09.003171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.004892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.012188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:09.015972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 507/1013] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:09.021839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:09.024546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1a343-c639-47fe-8ae2-a92537117ae2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:09.063516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.064714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.065153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.065645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.066934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.068396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.072768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 507/1014] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:09.076092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:09.132289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5f787-1f78-4b4b-9498-ed096d52a9cb None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:09.146580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:09.168876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.169893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.170193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.170460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.171177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:09.171494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.173057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee67c31-9731-4eca-86ca-45f1af1b9f0c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.183006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 508/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 5 12:40:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:09.183006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4396dac-9b6b-4748-b079-c49defb6e805 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.183006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4396dac-9b6b-4748-b079-c49defb6e805 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.183006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4396dac-9b6b-4748-b079-c49defb6e805 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.183006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 509/1016] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:09.183836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4396dac-9b6b-4748-b079-c49defb6e805 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:09.186508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff561-e5e4-4758-8d15-a08ec60a223c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:09.219410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.220077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.220363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.220633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.221366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.223535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6624e-e5e4-4f6b-992a-6cb650e525aa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.285303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4396dac-9b6b-4748-b079-c49defb6e805 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:09.327265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 508/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:09 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:09.327265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b126-4571-4490-a5bd-adbff90c7512 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.327265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b126-4571-4490-a5bd-adbff90c7512 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.327265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b126-4571-4490-a5bd-adbff90c7512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.327707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.327707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.327707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.327707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.328046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.328046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.329911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:09.374505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7ff8b126-4571-4490-a5bd-adbff90c7512 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:09.375776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7ff8b126-4571-4490-a5bd-adbff90c7512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:09.390133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 510/1018] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:40:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:09.487885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 509/1019] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:09 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:09.512252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:09.549228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:09.623217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07344eb7-7ff7-4560-98bb-cb1b25567647 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:09.659978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:09.660865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:09.661182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:09.661468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:09.662242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:09.663632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a665f-57aa-4162-a492-d14b1d3e3d77 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:09.758742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 511/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:09 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:11.432207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e74429-311e-4519-be06-ff48ead4e78d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.432906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e74429-311e-4519-be06-ff48ead4e78d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.432906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e74429-311e-4519-be06-ff48ead4e78d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.434084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 510/1021] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:11.439448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066148-12d1-4386-bf97-c4b176cc9d15 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.439875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066148-12d1-4386-bf97-c4b176cc9d15 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.440076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066148-12d1-4386-bf97-c4b176cc9d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.457971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cb066148-12d1-4386-bf97-c4b176cc9d15 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:11.459164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cb066148-12d1-4386-bf97-c4b176cc9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:11.535507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 512/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:11.552650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e0e5-4c20-451d-8e80-2ca574308215 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.552971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e0e5-4c20-451d-8e80-2ca574308215 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.553257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e0e5-4c20-451d-8e80-2ca574308215 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.554643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 511/1023] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:11.559900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.560145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e0e5-4c20-451d-8e80-2ca574308215 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:11.560252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.560468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.577584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:11.578767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:11.592538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:11.652718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 513/1024] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:11.672548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e0e5-4c20-451d-8e80-2ca574308215 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:11.677424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:11.703874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:11.710901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:11.714152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.714152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.714152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.714152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:11.714854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:11.721187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 512/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:11.722504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:11.791488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171c3e-dc64-49bc-a950-fda13c35f4a7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:11.831716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:11.832539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.832855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.833134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655944-d872-4a20-ab99-0daee345f3b2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:11.833238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.843338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-41b03dd5-1e1d-4cd5-9c1a-0af509ea993f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:11.852417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:11.853583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:11.854497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:11.857003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 514/1026] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:40:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:11.858982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ff6b-603d-4673-b21f-7b56347597b1 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.859282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ff6b-603d-4673-b21f-7b56347597b1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.859558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ff6b-603d-4673-b21f-7b56347597b1 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.860866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 515/1027] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:11.861565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415ff6b-603d-4673-b21f-7b56347597b1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:11.871800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:11.872471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.872785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.873063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.873439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:11.873784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:11.875210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20055de6-db3f-4d09-9bdd-4b076a020400 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:11.963720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415ff6b-603d-4673-b21f-7b56347597b1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:11.996489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:11.997184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:11.997474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:11.997762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:11.998521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:11.998834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.000203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.004079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 513/1028] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:11 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:12.005486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.005783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.006064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.019121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 516/1029] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:40:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:12.019121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.026208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:12.027456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:12.081816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.097076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.101022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 514/1030] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:12.124894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.133256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ae477-745e-486f-b595-5d6ff2610e85 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.173758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.175367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.175367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.175367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.188225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.189704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:12.208066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:12.209034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:12.209951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:12.209951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:12.209951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:12.209951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:12.210174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 517/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:12.215754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.239492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccd742-dd01-4862-bfed-b1cd94572977 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.277287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.278097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.278386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.278667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] PATH_INFO: `/v3/services/image` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.279409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.280834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:12.293303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:12.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:12.295685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 515/1032] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:12.301071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.335382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a062-cc7b-4238-b7ae-9b565d875f8b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.357805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.360047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.372440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.373436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.373721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.373996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.374728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:12.375034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.376576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.388315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 518/1033] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:12.394271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.411399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92fe4-4f6f-4267-b65e-4cb8a4059b15 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.448714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.449492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.449682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.450010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.450680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] RBAC: Adding query filter params (name=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:12.450997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.452381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.458211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 516/1034] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:12.463499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.500979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b05-4071-4450-8024-2ccb0bb1ee35 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.537519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.538390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.538680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.538960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.546953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.548406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:40:12.563375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:12.564355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:12.565427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 519/1035] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:12.570740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.579346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31423ebe-906a-43de-abd0-bcf47c901a6c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.593948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.616327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.617193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.617541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.617801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.618443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.618555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] RBAC: Adding query filter params (type=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:12.618751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.620119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.625124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 517/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:12.631641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.680978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e485f-c01d-4dd4-a0cc-bc8710ff0a5a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.715456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.716135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.716416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.716713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.717556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:12.717867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.719291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.736566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03b4c-9b9a-43b7-9233-12635e01eb53 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.740980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 520/1037] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:12.743517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.771720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065781a-3686-413d-992e-31e9da438103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.772303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065781a-3686-413d-992e-31e9da438103 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.772586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065781a-3686-413d-992e-31e9da438103 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.772884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065781a-3686-413d-992e-31e9da438103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.773678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065781a-3686-413d-992e-31e9da438103 None admin] RBAC: Adding query filter params (interface=public, service_id=b16fcc55fc1a45a887f0a13b08cd5da3, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:12.773987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065781a-3686-413d-992e-31e9da438103 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.775354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065781a-3686-413d-992e-31e9da438103 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.785493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 518/1038] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/endpoints?service_id=b16fcc55fc1a45a887f0a13b08cd5da3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:12.786744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065781a-3686-413d-992e-31e9da438103 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:12.831443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.846040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:12.849581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3812f-487e-4596-90fc-7fb02dd94d0c None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.888637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.889438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.889616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.889897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.898904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065781a-3686-413d-992e-31e9da438103 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:12.937221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:12.937890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:12.938191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:12.938516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:12.939308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.940735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:12.947816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 519/1039] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:40:12.961070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:12.962588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.077533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:13.086704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 521/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:40:13.087982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:13.198877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7c4a-854b-4e7c-b7d7-bfb773a19996 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:13.202246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:13.232769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:13.233826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:13.234116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:13.234391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:13.246318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:13.247765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:13.265083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:13.267192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:13.268074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:13.268074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:13.268074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:13.268074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:13.268074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 520/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:13.272930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:13.375939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b518d-a15c-4125-8157-0edf87346bfc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:13.410735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:13.411404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:13.411688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:13.411961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:13.412696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:13.413006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:13.414361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.426545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 522/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:13.432182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:13.532827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e17c8-9762-4660-ab33-84c84da3cdde None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:13.566558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:13.567398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:13.567682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:13.567953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:13.574819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:13.576249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:40:13.590673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:13.591728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:13.592622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 521/1043] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:13.600069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:13.661050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:13.701969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343c86-7362-438f-9cb0-eae1a13d2d98 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:13.736760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:13.737529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:13.738047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:13.738370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:13.739162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:13.739471 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:13.740912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41bbd-129f-4aab-8748-98c3f821f2e7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.753577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 523/1044] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:13.759536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:13.777568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:13.860012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3413-e0de-40c6-98bc-72796dbe3a76 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:13.894778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:13.895523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:13.895748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:13.896019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:13.896890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] RBAC: Adding query filter params (role.id=5c8bc83de6b54371a32313971b0b1dcc, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:13.897204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:13.898632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab796fa1-b024-4201-8f26-ba1ff474efdc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:13.912807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 522/1045] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:13 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=5c8bc83de6b54371a32313971b0b1dcc => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:14.151326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5597a4-5b0d-43e4-9e59-38c8f3a431e8 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.151698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5597a4-5b0d-43e4-9e59-38c8f3a431e8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.151902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5597a4-5b0d-43e4-9e59-38c8f3a431e8 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.153422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 524/1046] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:14.158510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.158818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.159783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.176402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:14.177555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:14.244596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 523/1047] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:14.269240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5597a4-5b0d-43e4-9e59-38c8f3a431e8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:14.375457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5597a4-5b0d-43e4-9e59-38c8f3a431e8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:14.395794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:14.410928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:14.411736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.412019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.412294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.422425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:14.430243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:14.431170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:14.437047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 525/1048] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:14.439493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:14.452988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:14.541523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91603-dc55-4291-ac2b-e14a678cfb41 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:14.575652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:14.576339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.576626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.576933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.577694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:14.578006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:14.579392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:14.588823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 524/1049] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:14.594335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:14.699296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ffa8-a91c-41db-9891-2a99522b0d5b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:14.741827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:14.742715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.742998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.743270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] PATH_INFO: `/v3/users/a58d4b11b2b94cd7b287c077e5242f7f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.757413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] RBAC: Authorizing `identity:get_user(user_id=a58d4b11b2b94cd7b287c077e5242f7f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:14.758866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6598a9-cd28-4347-8053-572f43fb95bf None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:14.765079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 526/1050] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:14 2022] GET /identity/v3/users/a58d4b11b2b94cd7b287c077e5242f7f => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:14.766314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:14.838874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:14.870967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9029a-d52a-4cd9-94d3-f244348bea10 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:14.905817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:14.906483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:14.906778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:14.907056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:14.977148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:14.978619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.005585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2e16-d3dc-48f6-a3ec-361c1058bf5a None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.005909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2e16-d3dc-48f6-a3ec-361c1058bf5a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.006148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2e16-d3dc-48f6-a3ec-361c1058bf5a None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.007632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 527/1051] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:15.012553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.012869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.013152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.030395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:15.031671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:15.062061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.064853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.098829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 525/1052] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:15.108784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 528/1053] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:15.108961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.126501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.214760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175c811-675c-4297-abf5-d39222302bf1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.234714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52f7b-862a-40cf-8e16-a86aed0a58e4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.250994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.251865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.252153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.252430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.253809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.255273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.257179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 526/1054] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:15 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:15.262851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.270926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.271728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.272012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.272286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.272977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.274333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:15.286290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:15.287286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:15.288119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 529/1055] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 5 12:40:15 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:15.293335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.310882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.326683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.370807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d56fda-88fa-49b0-bbd4-d6035360e8c0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.400966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1364e1-86b0-4bd1-8e9e-118cb6c130b9 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.405760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.406417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.406703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.406975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.408135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=c546286f8e5a484a812b5567a6010119, user.id=a58d4b11b2b94cd7b287c077e5242f7f) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:15.408247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.410354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.416220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 527/1056] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:15 2022] GET /identity/v3/role_assignments?user.id=a58d4b11b2b94cd7b287c077e5242f7f&scope.project.id=c546286f8e5a484a812b5567a6010119&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:15.438588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.439288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.439571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.439843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.440948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] RBAC: Adding query filter params (name=image) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:15.441306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.442758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.448703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 530/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:15.454362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.564148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1391506-20b3-40a5-868d-de5d4371eec8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.566778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.600851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.601538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.602093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.602530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.603545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] RBAC: Adding query filter params (type=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:15.603854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.605277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadad2c-c002-4075-be40-74877de0440e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.615373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 528/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:15.616605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:15.718095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:15.725056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f8d6-cc72-490a-b0ab-30ecf4c48256 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:15.759479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:15.760158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.760446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.760802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] PATH_INFO: `/v3/endpoints` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.761560 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:15.763008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06312b-bd29-42ad-8fa8-2f0ae7b8bdef None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:15.840793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 531/1059] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:40:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:15.966024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b391-9365-4fc9-af14-849daa664838 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.966403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b391-9365-4fc9-af14-849daa664838 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.966611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b391-9365-4fc9-af14-849daa664838 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.968160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 529/1060] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:15.974803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:15.975092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:15.975382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:15.994021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:15.995221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:16.076726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 532/1061] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:16.100299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8b391-9365-4fc9-af14-849daa664838 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:16.207277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8b391-9365-4fc9-af14-849daa664838 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:16.241564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:16.242379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:16.242665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:16.242942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:16.253117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:16.261380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:16.266913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:16.267773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 530/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:16.270548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:16.352427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:16.374979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95366a5d-ebb9-46b4-9253-db7a21d8fc3d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:16.410337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:16.411018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:16.411359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:16.411645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:16.412426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:16.413112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:16.414911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:16.428245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 533/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:16.429836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:16.460795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:16.536049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a850-f0df-4098-9f21-cc83ea13a671 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:16.570533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:16.571342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:16.571651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:16.571932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:16.583934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:16.585419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:16.602876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:16.603796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:16.604755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:16.604755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:16.604755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:16.604755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:16.609041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 531/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:16.610294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:16.712874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693af45-8354-4ae6-b90b-2c8f477cf2df None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:16.746106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:16.746786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:16.747054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:16.747330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:16.748049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:16.748359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:16.749748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:16.759114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:16.767581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 534/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:16.769712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:16.853455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:16.873759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6224d-e46a-413a-95d0-cff35e1d0a17 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:16.908165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:16.909121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:16.909413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:16.909793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:16.917568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:16.919011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:40:16.934017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:16.935022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:16.936002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 532/1066] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:16.941773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.055432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d341e-38f4-49d2-8e7c-dce0d640bd3f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.090573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.091266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.091554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.091836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.092736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:17.093059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.094504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.113222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 535/1067] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:40:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:17.118701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.219594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba397ee4-2d30-426b-9004-280f74d2d66f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.254153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.254953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.255308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.255595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.264386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.267013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.268581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:17.286565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:17.287681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:17.288562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:17.288562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:17.288562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:17.288562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:17.292752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 533/1068] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:17.294258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.354678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.398657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faae3b-7f67-47eb-9182-a22bbca07bac None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.434089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.434774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.435061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.435341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.436082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:17.436394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.437794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50eff-81c3-426f-94f7-510be47d76af None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.454591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 536/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:17.456411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.469947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4415-a017-4fa9-9abe-49ccd9080f10 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.470243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4415-a017-4fa9-9abe-49ccd9080f10 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.470527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4415-a017-4fa9-9abe-49ccd9080f10 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.472273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 537/1070] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:17.477002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.477291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.477572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.494931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:17.496125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:17.569683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 538/1071] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:17.573174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ded6-7a55-4bc6-a086-6ad2267202ba None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.592263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.608820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.609904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.610190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.610717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.620609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.622796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:40:17.642218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:17.643110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:17.644249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:17.649571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.649659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 534/1072] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:17.650138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.698605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892b0b8-ad74-499b-8746-10fcbe5fc897 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.713223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.736127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.737023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.737448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.738072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.748344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:17.756786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:17.757749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:17.758748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 539/1073] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:17.763948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.767172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0b56-799b-461b-98ef-067f00492135 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.803912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.804576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.804892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.805171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.805973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:17.806310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.807784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.824626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 535/1074] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:17.826268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.873981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5412203-f003-49a7-952c-5952b70468e3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.883647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.909639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.910243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.910530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.910812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.911577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:17.912050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.913457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41931ded-301b-4da3-a672-3c7ad2ab3af7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:17.922530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 540/1075] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:17.924069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cb3-0294-4237-8187-e53adb486046 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.925050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cb3-0294-4237-8187-e53adb486046 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.925345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1cb3-0294-4237-8187-e53adb486046 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.926684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 541/1076] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:17.927858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1cb3-0294-4237-8187-e53adb486046 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:17.938429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303637a3-71e1-4eb6-ae85-e37b90ad606f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:17.952289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:17.974158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:17.975054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:17.975340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:17.975622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/5c8bc83de6b54371a32313971b0b1dcc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:17.977883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=90b3884fbabf435dab3e9a017e9d2379, role_id=5c8bc83de6b54371a32313971b0b1dcc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:17.979419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564fb8a-79d2-4e51-9a2a-5448c6536d9f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.030030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1cb3-0294-4237-8187-e53adb486046 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.042983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 536/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:40:17 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/90b3884fbabf435dab3e9a017e9d2379/roles/5c8bc83de6b54371a32313971b0b1dcc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:40:18.044199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.044496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.044812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.072045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:18.073227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.074004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:18.074235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.074584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.074866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] PATH_INFO: `/v3/users/a58d4b11b2b94cd7b287c077e5242f7f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.076379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] RBAC: Authorizing `identity:get_user(user_id=a58d4b11b2b94cd7b287c077e5242f7f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.077967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.079744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 542/1078] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:17 2022] GET /identity/v3/users/a58d4b11b2b94cd7b287c077e5242f7f => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:18.085939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:18.132471 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:18.153484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 537/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:18.178394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:18.207320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05120adf-6cbe-47c6-a3d7-5e961bd89857 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.244605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.245748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.246041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.246696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.247964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.249439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.251293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 543/1080] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:18 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:18.257706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:18.287799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8483d-ce27-4aee-8e10-d7dfac3678d9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.289371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:18.327668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.328268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.328555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.328865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.366175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f1d3-0066-45ef-9755-6e7c439eecd1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.374599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:18.402082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.402426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.403543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.403909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.404293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.404826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119/users/a58d4b11b2b94cd7b287c077e5242f7f/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.407093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] RBAC: Authorizing `identity:create_grant(project_id=c546286f8e5a484a812b5567a6010119, user_id=a58d4b11b2b94cd7b287c077e5242f7f, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.408703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.483767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 544/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:40:18 2022] PUT /identity/v3/projects/c546286f8e5a484a812b5567a6010119/users/a58d4b11b2b94cd7b287c077e5242f7f/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:40:18.511398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 538/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:40:18.517232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:18.629420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618323-53f2-4a97-bb8a-701aacd132ff None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.666724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.667531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.667819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.668096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.679215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.680741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-b9fb711d-6c69-4168-b752-04f996ccd3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:18.698413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:18.699398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:18.700291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:18.700291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:18.700291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:18.700291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:18.700291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 545/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:18.705953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:18.708162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:18.805236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afebce-a107-429e-bdb7-06faaef59aed None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:18.839454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:18.840127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:18.840411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:18.840711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:18.841433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:18.841743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:18.843113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160229e-8882-42e4-aa25-4e371eeb434d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:18.855344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 539/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:20.089541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff3cc-1ddf-4736-b151-258e60a31944 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.090065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff3cc-1ddf-4736-b151-258e60a31944 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.090157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff3cc-1ddf-4736-b151-258e60a31944 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.091464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 546/1085] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:20.096649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.097084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.097329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.114603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:20.115807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:20.172784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.183595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 540/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:20.210612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff3cc-1ddf-4736-b151-258e60a31944 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.230320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.312774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff3cc-1ddf-4736-b151-258e60a31944 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.348504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.349353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.349639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.349917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.360154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:20.368889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:20.369917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:20.370764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 547/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:20.375964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.471948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6988b-1194-43a1-9c58-70095784b65c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.505018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.505695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.505981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.506255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.507001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:20.507306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:20.508661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6613207-c62b-444c-a7be-1720910df01c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:20.516501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 541/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:20.522608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.552454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d993-127e-4cb9-a146-48cce8a5bcbb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.552772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d993-127e-4cb9-a146-48cce8a5bcbb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.553046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d993-127e-4cb9-a146-48cce8a5bcbb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.554411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 542/1089] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:20.559220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.559505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.559780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.576198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:20.577344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:20.601846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.623011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e04eb-f78a-4e0c-91d7-1e576b8ddc61 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.627210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.645252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 543/1090] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:40:20.656542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.657374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.657711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.657996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.669154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.669393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:20.670854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:20.688182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:20.689183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:20.690353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:20.690353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:20.690353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:20.690353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:20.692830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 548/1091] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:20.695100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.765907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73683e-537c-4d42-98cb-dba1fb6ff50a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.794417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a24c5-fe81-4ac8-b3f8-ca9f8e1205cc None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.800055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.800888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.801200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.801478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.811469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:20.819346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:20.820365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:20.821280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 544/1092] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:20.822862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.826607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.828585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.829282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.829572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.829852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.831093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:20.831552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:20.833072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:20.845527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 549/1093] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:20.851639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.873113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:20.927702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128e4e-ee36-41ad-8663-f4162d3f720c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.951088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89ccdc-c047-4309-8b17-cf9194f77f2b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:20.960621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.961339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.961628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.961909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.962666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:20.962977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:20.964476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:20.972918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 545/1094] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:20.978596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:20.985755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:20.986552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:20.986953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:20.992310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:20.999823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.001353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:40:21.016319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:21.017336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:21.018342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 550/1095] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:21.023574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.073503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.080366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc913818-5f87-498e-8ff4-390a2946f393 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.087858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.115388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.116324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.116579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.116882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] PATH_INFO: `/v3/users/a58d4b11b2b94cd7b287c077e5242f7f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.118086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] RBAC: Authorizing `identity:get_user(user_id=a58d4b11b2b94cd7b287c077e5242f7f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.119506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.121218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 546/1096] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:20 2022] GET /identity/v3/users/a58d4b11b2b94cd7b287c077e5242f7f => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:21.127115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b63787-a528-4836-b55a-a9229eeb5e01 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.127568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.163927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.164608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.167333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.167627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.172819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:21.173147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.175261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.192607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 551/1097] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:21.199000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.228550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca8450-2387-4543-8d0b-0a4247df2191 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.262569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.263222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.263507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.263787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.298825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332176-1dcc-4c81-b240-24fafee0797e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.306601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.308141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.331562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.332580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.333003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.333315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.333606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.333890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.401812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.403411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.428856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 547/1098] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:40:21.434727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.503641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 552/1099] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:40:21.508844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.509350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.518700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.533102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc5ab-189b-48ee-870c-d9483d042a5c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.567510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.568371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.568656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.568964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.570155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.571587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.573325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 548/1100] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:21.579230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.606441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144b80-b5a1-46fe-911e-a821af1b4261 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.639935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.640767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.641055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.641333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.651868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.653352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:21.671172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:21.672194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:21.673726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:21.673726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:21.673726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:21.673726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:21.673726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 553/1101] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:21.677196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35917c-8fb1-442b-ae7f-809072e0484e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.677990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.711153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.711906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.712256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.712535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.713398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=c546286f8e5a484a812b5567a6010119, user.id=a58d4b11b2b94cd7b287c077e5242f7f) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:21.713707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.715131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.720872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 549/1102] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/role_assignments?user.id=a58d4b11b2b94cd7b287c077e5242f7f&scope.project.id=c546286f8e5a484a812b5567a6010119&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:21.737786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.782514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c439e-4ace-4feb-bb1b-039549806486 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.819393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.820080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.820363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.820638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.821407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:21.821712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.823104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:21.835319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 554/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:21.841128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:21.851271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:21.945859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f8a0-87f6-4377-b600-fbabc2210646 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:21.978435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:21.979232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:21.979514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:21.979787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:21.986556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:21.988842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:40:22.002953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:22.004045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:22.005099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 550/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:22.012215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:22.112977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc188a8-8cc6-499a-a6e2-ee6f2534f3ad None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:22.132054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:22.146109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:22.146774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:22.147057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:22.147331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:22.148118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:22.148427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:22.149892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e1b3f-0c33-4cbc-aa65-f1f21480784b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:22.162352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 555/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:22.168408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:22.233090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:22.266500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178a78-12c2-4e08-b0f6-7e026ef18d6f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:22.302637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] RBAC: Adding query filter params (role.id=5c8bc83de6b54371a32313971b0b1dcc, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=90b3884fbabf435dab3e9a017e9d2379) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:22.307229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9de80c-905b-4af3-afd2-7b57b536f423 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:22.312095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 551/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:22 2022] GET /identity/v3/role_assignments?user.id=90b3884fbabf435dab3e9a017e9d2379&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=5c8bc83de6b54371a32313971b0b1dcc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:23.780071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f691d1-0f8a-46ac-9841-f53f182bc8d4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:23.780664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f691d1-0f8a-46ac-9841-f53f182bc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:23.780664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f691d1-0f8a-46ac-9841-f53f182bc8d4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:23.782016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 556/1107] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:23.787668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:23.788056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:23.788232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:23.804497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:23.805717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:23.869338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 552/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:23.893964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f691d1-0f8a-46ac-9841-f53f182bc8d4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:23.993075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f691d1-0f8a-46ac-9841-f53f182bc8d4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:24.027525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:24.028326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:24.028613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:24.028930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:24.030153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:24.031541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc5e7-1af4-490d-b73d-aebddf5fb49c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:24.033172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 557/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:24.038840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:24.095164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:24.135626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44093adf-dd11-4bdc-a2d0-8ba14978bc5b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:24.168450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:24.169139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:24.169423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:24.169701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:24.170410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:24.171834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bc0ea-b5da-4513-8e87-35412b136759 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:24.260118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 553/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:24 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:26.311852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2c28-1b06-459d-af40-b6b709aad7a6 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:26.312361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2c28-1b06-459d-af40-b6b709aad7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:26.312361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2c28-1b06-459d-af40-b6b709aad7a6 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:26.313726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 558/1111] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:26.319509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:26.319916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:26.320077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:26.337603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:26.338813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:26.403732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 554/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:26.428220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2c28-1b06-459d-af40-b6b709aad7a6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:26.479368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:26.530577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2c28-1b06-459d-af40-b6b709aad7a6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:26.564130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:26.565598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:26.565917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:26.566152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] PATH_INFO: `/v3/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:26.567646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] RBAC: Authorizing `identity:get_role(role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:26.569037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:26.570380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 559/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:26 2022] GET /identity/v3/roles/26cba7b0722e440abff4c508da7eb0bb => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:26.576134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:26.620823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:26.672634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f740b-8b6f-4498-9717-98ad8016326f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:26.705576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:26.706444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:26.706730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:26.707005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] PATH_INFO: `/v3/users/cf144cf400aa4d4cacbc5076a250c2e6` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:26.719548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] RBAC: Authorizing `identity:get_user(user_id=cf144cf400aa4d4cacbc5076a250c2e6)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:26.721050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:26.722701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 555/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:26 2022] GET /identity/v3/users/cf144cf400aa4d4cacbc5076a250c2e6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:26.728346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:26.825212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774379c-bc63-435f-af05-74cfeea856e3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:26.841081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:26.857687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:26.860689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:26.860689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:26.860689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:26.925128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:26.926323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:27.020287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 560/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:27.026126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:27.123245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f813-2a9f-4d61-a513-2a7afff67c46 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:27.125429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:27.155223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:27.156078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:27.156362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:27.156637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:27.157874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:27.159860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183c71-4728-4aae-9b57-e705973535b7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:27.161835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 556/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:27 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:27.167677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:27.185084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:27.263143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a26d7-48a5-4bfc-89cd-32ec3864ee79 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:27.296909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:27.297591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:27.297911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:27.298188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:27.299016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=c546286f8e5a484a812b5567a6010119, user.id=cf144cf400aa4d4cacbc5076a250c2e6) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:27.299820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:27.301318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58ce1-6a33-4417-aed9-4f9b5ab4aeea None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:27.306720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 561/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:27 2022] GET /identity/v3/role_assignments?user.id=cf144cf400aa4d4cacbc5076a250c2e6&scope.project.id=c546286f8e5a484a812b5567a6010119&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:29.297374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaafc2-31d9-44fb-bebb-63061751bad2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.297873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaafc2-31d9-44fb-bebb-63061751bad2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.297873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaafc2-31d9-44fb-bebb-63061751bad2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.299810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 557/1118] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:29.304950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.305388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.305514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.322448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:29.323626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:29.388057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 562/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:29.411354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaafc2-31d9-44fb-bebb-63061751bad2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:29.510269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaafc2-31d9-44fb-bebb-63061751bad2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:29.542283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:29.543137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.543428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.543706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] PATH_INFO: `/v3/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.545221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] RBAC: Authorizing `identity:get_role(role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:29.546585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:29.547990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 558/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:29 2022] GET /identity/v3/roles/26cba7b0722e440abff4c508da7eb0bb => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:29.554270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:29.566260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:29.650727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6eca3-8320-4f8f-a424-69da1cd38d1d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:29.683625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:29.684488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.684919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.685204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] PATH_INFO: `/v3/users/cf144cf400aa4d4cacbc5076a250c2e6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.686385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] RBAC: Authorizing `identity:get_user(user_id=cf144cf400aa4d4cacbc5076a250c2e6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:29.687815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:29.689448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 563/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:29 2022] GET /identity/v3/users/cf144cf400aa4d4cacbc5076a250c2e6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:29.695207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:29.735471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:29.791263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b0671-4f7b-4f82-bfbe-3ec936a5ef8d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:29.823095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:29.823893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.824177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.824452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.825651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:29.827081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755fc2c-070f-494b-a617-b718bf6de548 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:29.828774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 559/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:29 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:29.835075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:29.910413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:29.930601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937f520-4d21-426e-bb8d-65855d7c7937 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:29.964052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:29.964959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:29.965248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:29.965524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119/users/cf144cf400aa4d4cacbc5076a250c2e6/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:29.967735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] RBAC: Authorizing `identity:create_grant(project_id=c546286f8e5a484a812b5567a6010119, user_id=cf144cf400aa4d4cacbc5076a250c2e6, role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:29.969192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830f6fc-0e52-45f5-9f82-4c7d6f6af05c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:30.025188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 564/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:40:29 2022] PUT /identity/v3/projects/c546286f8e5a484a812b5567a6010119/users/cf144cf400aa4d4cacbc5076a250c2e6/roles/26cba7b0722e440abff4c508da7eb0bb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:40:32.008505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1af1f-8341-4521-ae96-81549c633556 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.009144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1af1f-8341-4521-ae96-81549c633556 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.009144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1af1f-8341-4521-ae96-81549c633556 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.010483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 560/1124] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:32.015727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.016134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.016277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.032923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:32.035013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:32.099686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 565/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:32.123048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1af1f-8341-4521-ae96-81549c633556 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:32.221891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1af1f-8341-4521-ae96-81549c633556 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:32.230616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:32.254485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:32.255337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.255618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.255892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] PATH_INFO: `/v3/roles/26cba7b0722e440abff4c508da7eb0bb` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.257391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] RBAC: Authorizing `identity:get_role(role_id=26cba7b0722e440abff4c508da7eb0bb)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:32.258852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:32.260175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 561/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:32 2022] GET /identity/v3/roles/26cba7b0722e440abff4c508da7eb0bb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:32.266007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:32.330817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:32.363336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec373c-4c32-49df-96a0-b23a526b0e1c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:32.397130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:32.398026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.398739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.399024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] PATH_INFO: `/v3/users/cf144cf400aa4d4cacbc5076a250c2e6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.400226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] RBAC: Authorizing `identity:get_user(user_id=cf144cf400aa4d4cacbc5076a250c2e6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:32.401831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:32.403450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 566/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:32 2022] GET /identity/v3/users/cf144cf400aa4d4cacbc5076a250c2e6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:32.409614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:32.506676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567578f-da6d-4785-80dd-5c06f3748d0a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:32.539829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:32.540410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.540717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.541000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.583739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:32.605890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:32.607379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:32.702594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 562/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:40:32.709120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:32.806766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24ad43-431b-4815-9084-766b5f255057 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:32.839267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:32.840128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.840413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.840741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] PATH_INFO: `/v3/projects/c546286f8e5a484a812b5567a6010119` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.841928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] RBAC: Authorizing `identity:get_project(project_id=c546286f8e5a484a812b5567a6010119)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:32.843367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993fa1c-5757-4457-81ef-3d776736a89c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:32.845087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 567/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:32 2022] GET /identity/v3/projects/c546286f8e5a484a812b5567a6010119 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:32.851559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:32.924182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:32.946285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bc0f3-3e39-4885-91ec-54f738add1c3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:32.979793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:32.980434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:32.980737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:32.981015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:32.981835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] RBAC: Adding query filter params (role.id=26cba7b0722e440abff4c508da7eb0bb, scope.project.id=c546286f8e5a484a812b5567a6010119, user.id=cf144cf400aa4d4cacbc5076a250c2e6) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:32.982143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:32.983556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14c9c-57af-41ab-9b70-d9354f1ef424 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:32.989643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 563/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:32 2022] GET /identity/v3/role_assignments?user.id=cf144cf400aa4d4cacbc5076a250c2e6&scope.project.id=c546286f8e5a484a812b5567a6010119&role.id=26cba7b0722e440abff4c508da7eb0bb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:35.021121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6984b-ba53-4ae6-9105-8fc1ca633495 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.021661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6984b-ba53-4ae6-9105-8fc1ca633495 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.021661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6984b-ba53-4ae6-9105-8fc1ca633495 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.023022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 568/1131] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:35.028328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.028733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.028919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.045365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:35.046551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:35.110711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 564/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:35.134353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6984b-ba53-4ae6-9105-8fc1ca633495 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:35.138145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:35.234928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6984b-ba53-4ae6-9105-8fc1ca633495 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:35.268623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:35.271576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.271576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.271576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.271576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:35.272595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544524bd-23db-48d1-a98b-86e4e8d0a55b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:35.274197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 569/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:35.279877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:35.346108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:35.375399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ff601-ff71-491c-820f-93dd1ae9d7df None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:35.407953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:35.408650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.408958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.409237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.409936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:35.411366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15aee-26e3-46eb-ab4f-dfca19b45696 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:35.494604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 565/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:35 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:37.562794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b947d-445d-49bd-9365-773a2a24e618 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:37.563356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b947d-445d-49bd-9365-773a2a24e618 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:37.563356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b947d-445d-49bd-9365-773a2a24e618 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:37.565467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 570/1135] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:37.570699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:37.571096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:37.571260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:37.587692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:37.588918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:37.653910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 566/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:37.678717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b947d-445d-49bd-9365-773a2a24e618 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:37.747762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:37.777409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b947d-445d-49bd-9365-773a2a24e618 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:37.809652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:37.810442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:37.810726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:37.811000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:37.812153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:37.813657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4886f0-f3a9-4465-8b39-2e6145e8171d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:37.815854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 571/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:37.821501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:37.872064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:37.917091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c3e9a-5a6f-4aa5-8d43-cde9b95627ca None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:37.950046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:37.950703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:37.950985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:37.951261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:37.951967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:37.953413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278d09d-36e2-4988-9d2f-4bbc75b1e56e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:38.036638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 567/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:37 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:40.115141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcc21-d63c-44b4-a761-1f279aa93820 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.115634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcc21-d63c-44b4-a761-1f279aa93820 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.115749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcc21-d63c-44b4-a761-1f279aa93820 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.117098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 572/1139] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:40.122126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.122509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.122692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.139280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:40.140462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:40.204739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 568/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:40.228465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fcc21-d63c-44b4-a761-1f279aa93820 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:40.328719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fcc21-d63c-44b4-a761-1f279aa93820 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:40.361015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:40.362460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.362707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.362986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.370413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:40.374474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:40.382835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:40.390279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:40.391192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 573/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:40.391955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:40.429468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:40.487812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f856-a056-4819-b724-2aeeb70a6cc6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:40.520189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:40.520880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.521176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.521454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.522204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:40.522513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:40.523887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:40.531667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 569/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:40.537900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:40.634984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273711-4b90-43e6-9cd0-00db7df1fb52 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:40.667901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:40.668795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.669086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.669371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] PATH_INFO: `/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.682136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f1e123ec74c56a7c444cf86bc7dc6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:40.683575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:40.685218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 574/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:40 2022] GET /identity/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:40.691664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:40.786638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:40.789447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063215-36a5-4a28-ade2-d863b8f6c7dc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:40.822310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:40.822957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.823244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.823521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.887853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:40.889262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:40.980588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:40.984368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 570/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:40.990241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.047886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.087682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe42d5-49c4-4549-928f-fe1441bc6347 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.120796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.121661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.121946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.122225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] PATH_INFO: `/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.123402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b0144bfde9347e5b5a1b308acc0df2b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.124874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654c49f-46d4-4746-b585-c740bbd98ce7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.126553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 575/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:40 2022] GET /identity/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:41.132619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.229350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d54-d496-426a-b590-1fc329e7f7fe None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.262434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.263082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.263370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.263652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.264482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=2b0144bfde9347e5b5a1b308acc0df2b, user.id=1a9f1e123ec74c56a7c444cf86bc7dc6) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:41.264836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.266268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22952f-cbab-40f1-aaf7-48c35e7d4621 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.272582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 571/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/role_assignments?user.id=1a9f1e123ec74c56a7c444cf86bc7dc6&scope.project.id=2b0144bfde9347e5b5a1b308acc0df2b&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:43.251225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688cff-15f2-401c-8824-7d4c4bd87c6b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.251903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688cff-15f2-401c-8824-7d4c4bd87c6b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.251903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688cff-15f2-401c-8824-7d4c4bd87c6b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.253274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 576/1147] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:43.258509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be452-685e-4835-a560-04be54e4b19f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.258921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be452-685e-4835-a560-04be54e4b19f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.259071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be452-685e-4835-a560-04be54e4b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.276119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c42be452-685e-4835-a560-04be54e4b19f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:43.277275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c42be452-685e-4835-a560-04be54e4b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:43.334103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:43.342196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 572/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:43.365791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688cff-15f2-401c-8824-7d4c4bd87c6b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:43.464763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688cff-15f2-401c-8824-7d4c4bd87c6b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:43.490446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:43.498833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:43.504504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.504504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.504504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.510118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:43.517828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:43.518953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:43.520011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 577/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:43.525159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be452-685e-4835-a560-04be54e4b19f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:43.620398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be452-685e-4835-a560-04be54e4b19f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:43.652943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:43.653606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.653890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.654167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.654921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:43.655227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:43.656592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:43.664887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 573/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:43.670634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:43.768504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c3d9-1a46-46af-a6df-f85c221d6c92 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:43.801323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:43.802183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.802468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.802751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] PATH_INFO: `/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.803927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f1e123ec74c56a7c444cf86bc7dc6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:43.805389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:43.806971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 578/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:43 2022] GET /identity/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:43.812607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:43.867764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:43.910988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2ded-55ae-4087-a1a2-b8f94c1f58c4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:43.942407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:43.943261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:43.943544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:43.943820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] PATH_INFO: `/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:43.945027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] RBAC: Authorizing `identity:get_project(project_id=2b0144bfde9347e5b5a1b308acc0df2b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:43.946447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439c68e-3f92-4a7c-8bb0-a91495356171 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:43.948113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 574/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:43 2022] GET /identity/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:43.953972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.009513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:44.053673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a918c-7867-4f4a-9a1c-9babcb0ff351 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:44.086249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:44.087163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.087455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.087747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] PATH_INFO: `/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b/users/1a9f1e123ec74c56a7c444cf86bc7dc6/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.089768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b0144bfde9347e5b5a1b308acc0df2b, user_id=1a9f1e123ec74c56a7c444cf86bc7dc6, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:44.091202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b1254-4a17-4d8b-82bd-7eea3d8e7b08 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:44.149942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 579/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:40:43 2022] PUT /identity/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b/users/1a9f1e123ec74c56a7c444cf86bc7dc6/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:40:46.139051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b91a-11a2-432a-b02f-deae836f6926 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.139562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b91a-11a2-432a-b02f-deae836f6926 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.139686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b91a-11a2-432a-b02f-deae836f6926 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.140993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 575/1154] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:46.146614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263993c-7c93-4970-a775-11e47876a23d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.147008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263993c-7c93-4970-a775-11e47876a23d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.147185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263993c-7c93-4970-a775-11e47876a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.165105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-4263993c-7c93-4970-a775-11e47876a23d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:46.166296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4263993c-7c93-4970-a775-11e47876a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:46.231306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 580/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:46.255039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b91a-11a2-432a-b02f-deae836f6926 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.355285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b91a-11a2-432a-b02f-deae836f6926 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.378202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:46.388384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.389200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.389482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.389756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.400742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:46.409582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:46.410704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:46.411756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 576/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:46.416704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263993c-7c93-4970-a775-11e47876a23d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.460913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:46.513003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263993c-7c93-4970-a775-11e47876a23d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.545491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.546149 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.546436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.546715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.547456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:46.547762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.549186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.556971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 581/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:46.562580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.659326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f099-ea52-46e4-abe7-f04236e23c33 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.691642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.692491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.692798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.693070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] PATH_INFO: `/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.694236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f1e123ec74c56a7c444cf86bc7dc6)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.695659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.697287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 577/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/users/1a9f1e123ec74c56a7c444cf86bc7dc6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:46.702986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.800098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec361440-0eb5-4f62-a5df-d790e7e6641b None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.806692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:46.832891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.833538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.833822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.834097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.898880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.900316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.994190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 582/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:46.999957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:47.052346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:47.097052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064c46-6ea6-4052-b480-fd795764a956 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:47.130418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:47.131277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:47.131559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:47.131838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] PATH_INFO: `/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:47.133037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] RBAC: Authorizing `identity:get_project(project_id=2b0144bfde9347e5b5a1b308acc0df2b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:47.134467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3dafb-a0ec-4db0-b763-c3f0006b8a4a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:47.136148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 578/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/projects/2b0144bfde9347e5b5a1b308acc0df2b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:47.142285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:47.150320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:47.240519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5831d3-fb2a-4e0c-8620-7cadf7fe7099 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:47.273288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:47.273881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:47.274168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:47.274448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:47.275276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=2b0144bfde9347e5b5a1b308acc0df2b, user.id=1a9f1e123ec74c56a7c444cf86bc7dc6) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:47.275588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:47.277038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075123c-2ef4-47ad-817d-454672283b8d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:47.283314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 583/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:47 2022] GET /identity/v3/role_assignments?user.id=1a9f1e123ec74c56a7c444cf86bc7dc6&scope.project.id=2b0144bfde9347e5b5a1b308acc0df2b&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:49.317959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fabbf-eb40-469b-90e0-db863f98abb4 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:49.318460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fabbf-eb40-469b-90e0-db863f98abb4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:49.318460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fabbf-eb40-469b-90e0-db863f98abb4 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:49.319804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 579/1162] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:49.325227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:49.325671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:49.325848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:49.342683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:49.343856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:49.404849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:49.410016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 584/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:49.432273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fabbf-eb40-469b-90e0-db863f98abb4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:49.531020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fabbf-eb40-469b-90e0-db863f98abb4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:49.550190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:49.563361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:49.564647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:49.564965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:49.565245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:49.630616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:49.631995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:49.727083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 580/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:40:49.733154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:49.830114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52d89-f30b-4a51-8875-8232b9c72736 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:49.863684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:49.864479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:49.864794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:49.865075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:49.871642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:49.873105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-d976f1ed-49d9-46bc-9488-ee089d5df03f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:49.887640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:49.888909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:40:49.889970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 585/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:40:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:49.894700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:49.914960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:49.989455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed4be-e849-4dda-9052-740ff76947d5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:50.021872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:50.022534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:50.022814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:50.023089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:50.023810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:50.024112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:50.025505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a475a9-4aba-47c1-948a-eec011372fdb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:50.032563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 581/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 5 12:40:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:52.076444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc252c-48ff-446b-9765-9c5f5ef98e32 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:52.076987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc252c-48ff-446b-9765-9c5f5ef98e32 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:52.077082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc252c-48ff-446b-9765-9c5f5ef98e32 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:52.078373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 586/1167] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:52.084110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7a9-3726-4e75-bf97-5b537ff44ef2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:52.084499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7a9-3726-4e75-bf97-5b537ff44ef2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:52.084689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7a9-3726-4e75-bf97-5b537ff44ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:52.101630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2037f7a9-3726-4e75-bf97-5b537ff44ef2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:52.102819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2037f7a9-3726-4e75-bf97-5b537ff44ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:52.166611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 582/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:52.188995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc252c-48ff-446b-9765-9c5f5ef98e32 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:52.247414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:52.288735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc252c-48ff-446b-9765-9c5f5ef98e32 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:52.320591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:52.321282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:52.321567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:52.321846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:52.322596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:52.323958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c167-daa3-4207-8146-be058dd67a9c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:52.437072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 587/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Jul 5 12:40:52 2022] POST /identity/v3/domains => generated 267 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:54.482210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508416-7591-4e8c-9ceb-fb78311a8aaf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.482780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508416-7591-4e8c-9ceb-fb78311a8aaf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.482780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508416-7591-4e8c-9ceb-fb78311a8aaf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.484380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 583/1170] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:54.489541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.489990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.490090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.506811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:54.507983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:54.572200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 588/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:54.596070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508416-7591-4e8c-9ceb-fb78311a8aaf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:54.612169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:54.694941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508416-7591-4e8c-9ceb-fb78311a8aaf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:54.727838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:54.728714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.728999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.729269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] PATH_INFO: `/v3/domains/0f2a26d2f42a4371abbdde3a2f8a5d51` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.739657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f2a26d2f42a4371abbdde3a2f8a5d51)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:54.741077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee6aa-8f8e-41c8-bd0f-7c9d2ba8a36a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:54.742701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 584/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Jul 5 12:40:54 2022] GET /identity/v3/domains/0f2a26d2f42a4371abbdde3a2f8a5d51 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:54.748561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:54.796447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:54.843969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa103708-8d69-45d6-ac64-6ab51f3a192e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:54.877556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:54.878214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.878500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.878779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.879494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:54.880945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e79e-5bff-4c24-b8de-8f2d33c43966 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:54.933845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 589/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:54 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:56.984318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a0fd-752d-423e-bc5e-e3d39caf7958 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.984898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a0fd-752d-423e-bc5e-e3d39caf7958 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.984898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a0fd-752d-423e-bc5e-e3d39caf7958 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.986368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 585/1174] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:56.991531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.991935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.992105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.009154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:57.010352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:57.076527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 590/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:57.103049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a0fd-752d-423e-bc5e-e3d39caf7958 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.180910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.205782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a0fd-752d-423e-bc5e-e3d39caf7958 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.238371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.239171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.239453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.239726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] PATH_INFO: `/v3/domains/0f2a26d2f42a4371abbdde3a2f8a5d51` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.240924 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f2a26d2f42a4371abbdde3a2f8a5d51)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.242355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b57db-b889-4f76-8aae-4505524ca6f3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.243951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 586/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/domains/0f2a26d2f42a4371abbdde3a2f8a5d51 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:57.249729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.279606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.346206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82f2be-8400-4eb2-a7c2-e265016959f4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.380766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.381431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.381715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.381991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.382713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.384136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6249c-3a0a-4d7d-99df-9c4d1b33eebe None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.469657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 591/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:57 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:59.556934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892dcc6-836a-4da5-9123-9e674f3cb2d1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.557498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892dcc6-836a-4da5-9123-9e674f3cb2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.557498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892dcc6-836a-4da5-9123-9e674f3cb2d1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.558862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 587/1178] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:59.564555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.565020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.565137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.582099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:59.583276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:59.647882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 592/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:40:59.671778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892dcc6-836a-4da5-9123-9e674f3cb2d1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.774027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892dcc6-836a-4da5-9123-9e674f3cb2d1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.806572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.807413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.807651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.807928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.818414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:59.826137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:59.827289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:40:59.828599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 588/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:59.833903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.852503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:59.931706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95845ce-e630-43ed-b884-bf95dac5c62a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.964665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.965363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.965652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.965934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.966687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:59.966999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:59.968371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:59.976928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 593/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:59.982623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.986320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.082245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93459e-6188-4535-bdce-697082edacf6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.115893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.116793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.117078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.117352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] PATH_INFO: `/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.130579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] RBAC: Authorizing `identity:get_user(user_id=0ed6e4bfe1154952b91b6dced5fe15e0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.132010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.133671 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 589/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:00.139402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.217784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.237345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc1b4-df38-452d-9446-e4f926db8bd0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.269780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.270423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.270708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.270984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.382005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.383366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.465923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.484838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 594/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:41:00.491712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.549587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.588276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99b5d-2d34-4de6-a80e-55d0bdfee490 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.621086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.621944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.622230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.622509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] PATH_INFO: `/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.623691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] RBAC: Authorizing `identity:get_project(project_id=a7a4f18acbbd4a34ba349e1c26851a4b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.625157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0304526-d2ea-4652-bd7f-ae08e56edfae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.627495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 590/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:00.633625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.728215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28575b-5b60-4256-b22c-c4a3a92b4c3e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.761016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.761667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.761954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.762232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.763062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=a7a4f18acbbd4a34ba349e1c26851a4b, user.id=0ed6e4bfe1154952b91b6dced5fe15e0) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:00.763373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.764837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53b4b-f8cd-4ea5-adc3-14d8dbdddaec None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.772266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 595/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/role_assignments?user.id=0ed6e4bfe1154952b91b6dced5fe15e0&scope.project.id=a7a4f18acbbd4a34ba349e1c26851a4b&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:02.795811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b159-7b12-4494-9fec-2f065f3f3d4b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.796342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b159-7b12-4494-9fec-2f065f3f3d4b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.796342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b159-7b12-4494-9fec-2f065f3f3d4b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.797991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 591/1186] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:02.803494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.803899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.804044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.821234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:02.822401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:02.862884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:02.888791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 596/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:41:02.912495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532b159-7b12-4494-9fec-2f065f3f3d4b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.011325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532b159-7b12-4494-9fec-2f065f3f3d4b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.037446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.044968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.045756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.050736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.050736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.056734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:03.064359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:03.065482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:41:03.066698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 592/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:03.071725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.166656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545838c-9b2c-4a37-a804-0f2dedd5a911 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.199167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.199829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.200114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.200390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.201166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:03.201472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.202828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.210566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 597/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:03.216255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.314904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46144-83ad-429a-bf48-c58c7ad94e46 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.347745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.348609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.348923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.349222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] PATH_INFO: `/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.350416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] RBAC: Authorizing `identity:get_user(user_id=0ed6e4bfe1154952b91b6dced5fe15e0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.351847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.353506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 593/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:03.359497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.394710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.458439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0208-bd04-4a81-9f38-882479557093 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.491303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.492158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.492442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.492750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] PATH_INFO: `/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.493934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] RBAC: Authorizing `identity:get_project(project_id=a7a4f18acbbd4a34ba349e1c26851a4b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.495363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d493c63-543a-4192-ab19-45a55293ea9a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.497067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 598/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:03.503057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.557812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.600270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46951-cbbe-43d8-8819-20f95635551f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.632522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.633432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.633719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.633995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] PATH_INFO: `/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b/users/0ed6e4bfe1154952b91b6dced5fe15e0/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.635964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a4f18acbbd4a34ba349e1c26851a4b, user_id=0ed6e4bfe1154952b91b6dced5fe15e0, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.637435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd056-8d23-460d-a653-52a066d1c421 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.693683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 594/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:03 2022] PUT /identity/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b/users/0ed6e4bfe1154952b91b6dced5fe15e0/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:05.678282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c86cbc-50e5-4154-9707-5dffba86c7d3 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.678843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c86cbc-50e5-4154-9707-5dffba86c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.678843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c86cbc-50e5-4154-9707-5dffba86c7d3 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.680177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 599/1193] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:05.685258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.685677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.685812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.702711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:05.703891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:05.769708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 595/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:41:05.792539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c86cbc-50e5-4154-9707-5dffba86c7d3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.892239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c86cbc-50e5-4154-9707-5dffba86c7d3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:05.894565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:05.925499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:05.926296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.926583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.926864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.937243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:05.945827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:05.946845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:41:05.947714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 600/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:05.953031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.997731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.050219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b6f1f-36c9-4dd3-8549-bac6b68736d1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.083178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.083844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.084127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.084401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.085175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:06.085484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.086839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.094508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 596/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:06.100319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.198435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ae42-3c65-46bb-8588-c4eb79b8c056 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.230767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.231634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.231931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.232217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] PATH_INFO: `/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.233434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] RBAC: Authorizing `identity:get_user(user_id=0ed6e4bfe1154952b91b6dced5fe15e0)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.235210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.236838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 601/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/users/0ed6e4bfe1154952b91b6dced5fe15e0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:06.242614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.340078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6e5c-92e9-409e-b640-637474112715 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.348796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.373697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.374342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.374630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.374910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.440571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.442243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.535531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 597/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:41:06.541394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.573183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.640591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decac5ed-a4a4-4c8d-b39b-71b80d5b05cb None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.673382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.674240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.674523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.674798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] PATH_INFO: `/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.675971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] RBAC: Authorizing `identity:get_project(project_id=a7a4f18acbbd4a34ba349e1c26851a4b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.677418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3100c9-b900-4c1d-a57a-d2e5502b907c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.679072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 602/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/projects/a7a4f18acbbd4a34ba349e1c26851a4b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:06.685069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.695474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.781481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b497a5-364d-45fb-bf95-b1b59c8aa2ad None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.815184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.815771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.816056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.816335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.817208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=a7a4f18acbbd4a34ba349e1c26851a4b, user.id=0ed6e4bfe1154952b91b6dced5fe15e0) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:06.817526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.818958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e646977-0215-4f49-954f-af106ac2496c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.824643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 598/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/role_assignments?user.id=0ed6e4bfe1154952b91b6dced5fe15e0&scope.project.id=a7a4f18acbbd4a34ba349e1c26851a4b&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:16.669236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=50 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.822026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=64 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.214083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e85bf-b7d3-4b43-a0f4-d2260fb56eff None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.214655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e85bf-b7d3-4b43-a0f4-d2260fb56eff None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.214655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e85bf-b7d3-4b43-a0f4-d2260fb56eff None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.216003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 603/1201] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:19.221829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.222252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.222408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.239477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:19.240659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:19.306015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 599/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:19.331086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e85bf-b7d3-4b43-a0f4-d2260fb56eff None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.432887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e85bf-b7d3-4b43-a0f4-d2260fb56eff None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.466401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.467307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.467587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.467862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.478128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.479562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:19.496459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:19.498295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:19.499525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:19.499525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:19.499525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:19.499525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:19.499525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 604/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:19.504361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.602076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa94eae-0650-4793-a380-c32f9c3e89d0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.630432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.635447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.639695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.639695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.639695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.639695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:19.639695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.640138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474ff34-5ce3-4b89-8db1-174be6813072 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.650793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 600/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:19.656594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.709371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.756289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1cf2-a4c9-425e-84fd-8639db9d410a None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.789181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.789986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.790270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.790543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.791239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.792662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116708ba-e88c-41ac-aff1-0a91ad7c57d6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.908969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 605/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 5 12:42:19 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:21.974875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0815-29e2-4342-998e-db00e145b654 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.975433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0815-29e2-4342-998e-db00e145b654 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.975433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0815-29e2-4342-998e-db00e145b654 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.976849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 601/1206] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:21.982162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.982601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.982733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.000382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:22.001608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:22.068682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 606/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:22.093021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0815-29e2-4342-998e-db00e145b654 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.194964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0815-29e2-4342-998e-db00e145b654 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.226939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.227667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.227949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.228223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.239149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:22.246755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:22.248640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:22.249571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 602/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:22.254782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.293445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.351731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5c6e-7f68-45f6-95ed-03ff59bb8ae9 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.386039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.388209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.388209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.388209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.388209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.388604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.389893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.397848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 607/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.403516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.453711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.501973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d650-5f2e-4a3a-a1a3-1ea3d80d728f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.535575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.536369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.536648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.536946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.547182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.548652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:22.566160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:22.568321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:22.569689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:22.569689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:22.569689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:22.569689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:22.569689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 603/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:22.573385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.670886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.673869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873974-b8a8-47ed-8c28-9634c3c07da6 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.706136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.706803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.707089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.707370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.708128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.708435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.709841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.722683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 608/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.728530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.829123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b0238-b3d3-48e5-90b7-03f74aa5ec03 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.830568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.863553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.863553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.863553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.863957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.871351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.872828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:22.886981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:22.894309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:22.895531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 604/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:22.896179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.993621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f2fcc-4751-4754-8ff3-47385509d48f None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.027407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.028082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.028364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.028636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.030084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:23.030393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.031810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.048381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 609/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:23.054200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.160246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd204c-e487-41e6-b31b-73b8422a8dc5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.193577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.194231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.194517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.194795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.224062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.260336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.261813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.357909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 605/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:23.363931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.383167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.462786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb5974-895a-4769-b8d0-5e7e123ed186 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.497061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.498123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.498459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.498738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.508460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.509931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:23.527539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:23.530495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:23.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:23.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:23.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:23.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:23.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 610/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:23.535126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.594891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.631718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9d5c-19c6-4808-beed-838966063ef2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.664536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.665242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.665523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.665796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.666525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:23.666829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.668198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.679777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 606/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:23.685811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.755622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.786326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c08da-f69f-4c84-b14e-99dd1a0d3169 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.819009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.819810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.820094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.820369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.827620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.829103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:23.842645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:23.843685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:23.844636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 611/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:23.849984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.948968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794afd-50ff-478c-97cd-cfd9b41237af None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.970894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.982615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.983347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.983631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.983907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.984984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:23.985297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.986726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b821a-3504-432b-bb7b-4119cd3dd883 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.998494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 607/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:24.004646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:24.104321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311481-4b8c-484a-8dec-c1be46078413 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:24.132245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:24.137951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:24.139011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.139416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.139828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.140970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=fc48d9e605e242d19446c497bde122f9) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:24.141283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:24.142725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f80-88be-4594-b906-9230ef696a9b None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:24.148122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 612/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:24 2022] GET /identity/v3/role_assignments?user.id=fc48d9e605e242d19446c497bde122f9&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.148840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b04e-38bf-4fac-b4e6-3c0780084a9e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.149423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b04e-38bf-4fac-b4e6-3c0780084a9e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.149423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b04e-38bf-4fac-b4e6-3c0780084a9e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.150754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 608/1220] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:26.156516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.163896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.163896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.173879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:26.175069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:26.250208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 613/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:26.276313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b04e-38bf-4fac-b4e6-3c0780084a9e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.373553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b04e-38bf-4fac-b4e6-3c0780084a9e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.406448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.407237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.407521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.407796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.417763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:26.425523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:26.431328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:26.432426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 609/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:26.433443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.532418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b82062-d966-4a4b-bb37-877ac69b308d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.555456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.566683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.567390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.567675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.567952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.568743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.569059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.570483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.578723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 614/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.584625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.627859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.684513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11bac9-358b-4b89-8070-3c8315047849 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.718048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.718847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.719131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.719407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.729499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.730941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:26.748561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:26.749630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:26.750562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:26.750562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:26.750562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:26.750562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:26.750562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 610/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:26.755794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.854709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d21456-da3c-4128-bfbc-90e1c096a9e7 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.887810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.889320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.889610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.889890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.890615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.890920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.892279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.904344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 615/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.910277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.003810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.010953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b112c-d0c0-4300-bcaf-da2fa6623441 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.044877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.045728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.046033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.046342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.053682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.055274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:27.070246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.072862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:27.074134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 611/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:27.078183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.126092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.177502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ed16-95bb-4796-89a8-91dbdbce76d3 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.213339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.214015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.214299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.214577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.215413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.215824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.217465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.234318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 616/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.240326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.338631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc8b9-0782-4bfc-bb7c-890354d5f499 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.371459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.372261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.373343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.373460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.383523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.384935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:27.401840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.403287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.404607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:27.404607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:27.404607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:27.404607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:27.404607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 612/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:27.408981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.506441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618f6f-2b01-4ea6-8e2a-5cffa2753a97 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.508856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.539412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.540080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.540367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.540647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.547371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.547371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.547371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.554412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 617/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.560839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.570047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.659263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ea1b0-3cbf-4211-a4f6-cee815e2244e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.691913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.692728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.693014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.693289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.699737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.701404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:27.715257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.720251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:27.721427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 613/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:27.723132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.823429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f16ef-9143-40ab-839f-79ed68066068 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.856032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.857330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.857886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.858168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.858960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.859273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.860988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d32a3-01a7-4c0b-b4af-19a35ad87a50 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.872930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 618/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.878901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.943782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.977588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b8142-93f0-4eef-8c67-33388b1e6303 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.012456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.014057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.014346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.014624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/fc48d9e605e242d19446c497bde122f9/roles/3ca44c4f289045d1917f8ed5c43455e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.030369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=fc48d9e605e242d19446c497bde122f9, role_id=3ca44c4f289045d1917f8ed5c43455e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.031819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05eb64-02d3-404b-a4d7-c4ed1d30224d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.120015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 614/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:27 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/fc48d9e605e242d19446c497bde122f9/roles/3ca44c4f289045d1917f8ed5c43455e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:30.141582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe3a3-9d16-40d6-94b1-34da1b596121 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.142126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe3a3-9d16-40d6-94b1-34da1b596121 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.142126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe3a3-9d16-40d6-94b1-34da1b596121 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.143521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 619/1233] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:30.148758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.154562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.154562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.165612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:30.166817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:30.233370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 615/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:30.258320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe3a3-9d16-40d6-94b1-34da1b596121 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.284099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.362343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe3a3-9d16-40d6-94b1-34da1b596121 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.396985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.397794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.398081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.398356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.408513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:30.416256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.420353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:30.421247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 620/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.424183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.469676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.523144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc4572-5c76-4b10-a936-f823a2d8c270 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.555945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.556550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.556861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.557134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.557882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.558218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.560254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.569064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 616/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:30.574739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.659112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.675468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb7329-1741-4bed-8b0b-82d25daccfd0 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.708221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.709051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.709338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.709616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.720356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.721858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:30.739605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.740659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.741834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:30.741834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:30.741834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:30.741834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:30.741834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 621/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.746590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.842067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde6e42-eb75-4179-806e-d0b65464adc9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.851045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.875203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.875856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.876135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.876406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.877150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.877454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.878805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.889736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 617/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:30.895357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.996064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0add8a-d17a-41c2-a8ab-1218b74d7df5 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.031085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.031885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.032167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.032440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.035287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.040319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.041827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:31.055941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:31.059668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:31.060878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 622/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:31.063120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.167185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f450-20e6-4508-a130-b52c454f2f2d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.199960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.201479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.201856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.202136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.202987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.203302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.204763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.222586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 618/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.228464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.327037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0af96a-3263-444f-a69b-2ebeecdba14e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.361542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.362197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.362481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.362755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.425226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.431975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.433786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.535527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 623/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:31.541380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.568990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.642622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6b6b-457f-4a5c-806e-57037282cfd5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.675637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.676364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.676649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.676962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.688238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.689744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:31.708284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:31.709396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:31.710439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:31.710439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:31.710439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:31.710439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:31.710439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 619/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:31.715246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.808354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.814572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8610a-1153-4071-ac4d-f57ff3d35d19 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.847446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.848112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.848398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.848689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.849434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.849742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.851224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.863504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 624/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.873099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.946203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.966377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8494025-3865-4ac4-a0bb-e081a820db70 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.000820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.001609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.001887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.002155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.008622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.010123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:32.051035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:32.052118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:32.053262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 620/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:32.053869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.129191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb436-3abf-459a-a917-361c7145bd47 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.162348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.163005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.163292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.163567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.164405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.164746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.166214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3989-17ec-44b3-acb5-657f11469065 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.178727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 625/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:32.185280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.285014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c431af-8f93-481d-99aa-fcf34662dc4d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.318911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.319596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.319878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.320153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.321011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] RBAC: Adding query filter params (role.id=3ca44c4f289045d1917f8ed5c43455e3, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=fc48d9e605e242d19446c497bde122f9) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.321319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.322737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c73cf-aa5c-4870-a6d0-5f914dc51229 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.328650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 621/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/role_assignments?user.id=fc48d9e605e242d19446c497bde122f9&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=3ca44c4f289045d1917f8ed5c43455e3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:34.414109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314356f-d2a8-4dad-825a-e5fda5a60319 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.414624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314356f-d2a8-4dad-825a-e5fda5a60319 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.414624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314356f-d2a8-4dad-825a-e5fda5a60319 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.415993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 626/1247] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:34.421983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.422432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.422582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.427576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.439828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:34.441172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:34.506006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 622/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:34.530705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314356f-d2a8-4dad-825a-e5fda5a60319 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.549251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.632034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314356f-d2a8-4dad-825a-e5fda5a60319 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.665114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.665849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.666137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.666414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.677002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:34.685053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:34.686181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:34.687039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 627/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:34.691899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.791725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2b03c-73fd-4720-8163-728a2fe10b34 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.819993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.825613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.826448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.826750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.827030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.827816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:34.828126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.829624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.838006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 623/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:34.844757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.923026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.945617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3717-d32c-4d7a-859f-a72cde2ad92e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.978896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.979696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.979979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.980256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.992678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.994196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:35.012339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:35.013398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:35.014480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:35.014480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:35.014480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.014480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:35.014480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 628/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:35.019412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.118922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0a29d-0436-485c-a48b-ea9ecfbd23c7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.154180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.154848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.155135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.155416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.156142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:35.156452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.157862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.170428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 624/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:35.176204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.276542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08d8a-bace-4eac-bd60-e58900e6a2e8 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.302499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.310531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.311376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.311667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.311949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.319691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.321347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:35.335999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:35.336956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:35.337928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 629/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:35.343297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.397695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.441402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22c20-3b49-4909-93ba-8ae4f2604108 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.474043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.474710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.478348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.478348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.478348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:35.478348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.478348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.494735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 625/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:35.501292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.600682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3a0b4-2b83-4c24-b3f1-8afd759db5e1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.638788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.639477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.639755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.640030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.694386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.706493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.707987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.806839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 630/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:35.813580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.914165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a82ede-ff66-445a-b986-18d9a9822931 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.928263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.955141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.955141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.955141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.955141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.964884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.966409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:35.983489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:35.984930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:35.985923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:35.985923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:35.985923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.985923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:35.985923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 626/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:35.990892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.078079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.089529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4b90-b8fe-45cb-9e87-3f8ac3342677 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.123916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.124693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.124914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.125222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.125948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.126256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.127642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.140369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 631/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:36.146164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.243383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9322-6f0e-4f50-b5bd-e804f3416356 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.277105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.277894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.278285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.278793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.285414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.286860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:36.300898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:36.303212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:36.304323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 627/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:36.308094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.408187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6828d-2753-418d-a1d7-83c897177d43 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.440214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.440896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.441179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.441451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.442237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.442544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.443963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727cc93-b72f-445e-a754-0374ab6fe769 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.456281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 632/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:36.462289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.488163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.559294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b900cee-e179-4607-95a3-dea0fa443c1a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.593561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.594225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.594512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.594792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.595628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=fc48d9e605e242d19446c497bde122f9) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.595942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.597421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc61ed-c3b1-45bd-9429-b549be8e9069 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.603015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 628/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/role_assignments?user.id=fc48d9e605e242d19446c497bde122f9&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:38.624072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a73c2-5176-4503-b4e5-39ab892ddedc None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:38.624605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a73c2-5176-4503-b4e5-39ab892ddedc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:38.624605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a73c2-5176-4503-b4e5-39ab892ddedc None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:38.626007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 633/1261] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:38.631426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:38.631847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:38.632209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:38.649365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:38.650614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:38.718125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 629/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:38.741246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a73c2-5176-4503-b4e5-39ab892ddedc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:38.752322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:38.842269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a73c2-5176-4503-b4e5-39ab892ddedc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:38.875458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:38.876192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:38.876481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:38.876793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:38.886964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:38.895228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:38.899873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:38.900988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 634/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:38.902625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:38.921129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:38.999431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03d37-fbb6-4f46-8dc9-7df206d663b0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.043371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.044052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.044335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.044611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.045399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:39.045708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.047074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.055025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 630/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:39.061628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.129635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.162726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9016b-c898-469b-a0b4-7636b8c7cfde None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.196179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.197061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.197350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.197632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.209191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.210640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:39.228566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:39.233804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:39.235135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:39.235135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:39.235135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:39.235135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:39.235135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 635/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:39.236201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.318333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.338212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423444ba-e3fb-4f22-874a-fc4605c33f8d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.374859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.375544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.375817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.376090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.376843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:39.377149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.378518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.390219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 631/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:39.396114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.494837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a6f-7db5-4323-8648-dc26ee7f5cb4 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.516009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.530515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.531392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.531687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.531968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.539435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.540902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:39.555091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:39.556223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:39.557574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 636/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:39.562112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.661906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9a6f-24ba-4386-8d7f-33704de9027d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.695621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.696280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.696565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.696873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.697707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:39.698014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.699436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.708367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.716764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 632/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:39.722551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.824272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d884-2092-4dd3-a116-237b7d0b6744 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.858067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.858857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.859138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.859409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.871029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.873348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:39.891437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:39.892558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:39.893776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:39.893776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:39.893776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:39.893776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:39.893776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 637/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:39.898402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.004027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb63fe-fdee-435b-9b63-8dbd41c6c6e9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.041548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.042224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.042505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.042776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.043499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:40.044902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.046271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.062390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 633/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:40.068002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.100182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.170745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9676-e57e-4233-9a7d-9aa29baf8e6e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.204234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.205161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.205449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.205752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.212595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.214070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:40.228709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:40.232346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:40.233576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 638/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:40.236652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.296137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.338330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddd08-f47f-4003-9d87-18ced811dddf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.371324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.372845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.373142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.373422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.374216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:40.374616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.376051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c169158-8fa6-4d4b-b234-b24d2b9a3fa3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.388105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 634/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:40.394232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.493569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.502105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238720-e6fb-4f67-820d-6a378299bb9e None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.535574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.536564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.536878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.537159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] PATH_INFO: `/v3/projects/ed5a949286664639960c0028fe634a16/users/fc48d9e605e242d19446c497bde122f9/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.539192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a949286664639960c0028fe634a16, user_id=fc48d9e605e242d19446c497bde122f9, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.540630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355a30e-646a-4dbe-8cf6-ce099e3856c7 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.680664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 639/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:40 2022] PUT /identity/v3/projects/ed5a949286664639960c0028fe634a16/users/fc48d9e605e242d19446c497bde122f9/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:42.709186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6e88-5ed1-450d-864f-2fdefbf94009 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.709742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6e88-5ed1-450d-864f-2fdefbf94009 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.709742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6e88-5ed1-450d-864f-2fdefbf94009 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.711111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 635/1274] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:42.716203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.716575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.717387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.732986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:42.734161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:42.799816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 640/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:42.824217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6e88-5ed1-450d-864f-2fdefbf94009 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.925828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6e88-5ed1-450d-864f-2fdefbf94009 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.942591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:42.958752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.959601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.959882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.960155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.970415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:42.978027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:42.979143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:42.980162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 636/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:42.986192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.067713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.085578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba8610-1145-47df-aaba-fee7468425c0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.118636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.119305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.119589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.119865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.120615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:43.120954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.122353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.130557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 641/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:43.135865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.237504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500f92-5e14-485c-88e0-6d34ef895845 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.270036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.270822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.271100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.271374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.282118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.283554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:43.300023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:43.301125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:43.302402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:43.302402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:43.302402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:43.302402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:43.302402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 637/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:43.307058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.407754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0248b-d891-4b1b-ab23-2e51dff260ae None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.441319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.442041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.442325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.442602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.443329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:43.443638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.445041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.458403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 642/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:43.464110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.494780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.563785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1949b2-4924-45ce-b300-8060fec300ed None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.596547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.597367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.597648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.597947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.605154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.606958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:43.621088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:43.622918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:43.624109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 638/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:43.629108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.632863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.724242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e2cd-c83a-4022-a519-6641c071d825 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.758596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.759246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.759531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.759809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.760648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:43.760987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.762991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.779885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 643/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:43.785890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.876218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.885478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658c946-8dfd-412b-9c13-e1e94770475e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.919519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.920242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.920800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.921447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.990810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.992312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.080317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.090293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 639/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:44.096109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.157426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.194621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4843e-8a09-4ea4-a8dc-1b1abf8755f1 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.228347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.229188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.229475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.229752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.240709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.242155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:44.259610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:44.260659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:44.261939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:44.261939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:44.261939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:44.261939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:44.261939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 644/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:44.266708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.362872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494ef77-372d-4c3b-a061-8016c0afcc0e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.395860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.396523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.396841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.397121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.397843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.398151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.399517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.411795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 640/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:44.417492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.517372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44949c-36ab-49ee-ab8c-948f0feb3f24 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.531509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.551541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.552344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.552628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.552998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.560793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.570567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:44.577981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:44.579033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: ERROR keystone.server.flask.application Jul 05 12:42:44.580296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 645/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:44.585014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.636071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.686835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f835-a2a4-460c-b25c-69388ef1ce92 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.721487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.722147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.722430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.722704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.723491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.723797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.725260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be054e1-0449-4778-b08b-e52e37416bf7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.738394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 641/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:44.744516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.845581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fa606-83ab-4fd3-8b44-e27be9ef127d None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.884928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084813de-a820-4573-b233-3595c87abca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.885612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084813de-a820-4573-b233-3595c87abca4 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.885898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084813de-a820-4573-b233-3595c87abca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.886231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084813de-a820-4573-b233-3595c87abca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.887029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084813de-a820-4573-b233-3595c87abca4 None admin] RBAC: Adding query filter params (role.id=ebbfe49b13964adab174b6721d50a779, scope.project.id=ed5a949286664639960c0028fe634a16, user.id=fc48d9e605e242d19446c497bde122f9) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.887382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084813de-a820-4573-b233-3595c87abca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.889088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084813de-a820-4573-b233-3595c87abca4 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.908702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 646/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/role_assignments?user.id=fc48d9e605e242d19446c497bde122f9&scope.project.id=ed5a949286664639960c0028fe634a16&role.id=ebbfe49b13964adab174b6721d50a779 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:46.993407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb69-d791-4742-8640-bac5a20ef90a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:46.993954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb69-d791-4742-8640-bac5a20ef90a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:46.993954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb69-d791-4742-8640-bac5a20ef90a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:46.995307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 642/1288] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:47.001055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.001523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.001622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.018689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:47.019896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:47.049833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:47.087690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 647/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:47.111809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5bb69-d791-4742-8640-bac5a20ef90a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.211896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5bb69-d791-4742-8640-bac5a20ef90a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.222938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:47.247081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.247814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.248099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.248376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.249074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.250467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:47.262139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:47.263352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:47.264365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 643/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:47.269364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.369134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe948-152c-44e1-9d7f-4c340382a282 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.403353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.404116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.404404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.404736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.405449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:47.405759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.407127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b301d-149c-4486-9f5c-eaa3fed9587c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.412159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 648/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 5 12:42:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:47.418086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.519514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e003db-f2b0-4231-a484-3161d67c5673 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.552840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.553559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.553846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.554147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.554859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:47.555171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.556538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e874-9627-4bc8-a048-cefbbb173564 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.561256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 644/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 5 12:42:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:49.575930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141976e1-504f-4f53-972d-92b1676f449a None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.576486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141976e1-504f-4f53-972d-92b1676f449a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.576486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141976e1-504f-4f53-972d-92b1676f449a None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.577847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 649/1293] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:49.583106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4536-ea09-438a-9db3-8082fbce99b2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.583504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4536-ea09-438a-9db3-8082fbce99b2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.583670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4536-ea09-438a-9db3-8082fbce99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.601006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-68fc4536-ea09-438a-9db3-8082fbce99b2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:49.602205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-68fc4536-ea09-438a-9db3-8082fbce99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:49.631360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.667290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 645/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:49.690544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141976e1-504f-4f53-972d-92b1676f449a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.721506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.792132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141976e1-504f-4f53-972d-92b1676f449a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.828141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.828765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.829052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.829327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.830050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.831406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d964c-27e1-4d44-ad01-0e321de4323e None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.914286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 650/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:49 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:51.954177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d18f38-0799-422a-918d-d3e5d2771f95 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:51.954729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d18f38-0799-422a-918d-d3e5d2771f95 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:51.954729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d18f38-0799-422a-918d-d3e5d2771f95 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:51.956095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 646/1296] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:51.961264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:51.961665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:51.962704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:51.979252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:51.980422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:52.057877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 651/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:52.081932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d18f38-0799-422a-918d-d3e5d2771f95 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.184583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d18f38-0799-422a-918d-d3e5d2771f95 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.219277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.220074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.220360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.220639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.221337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.222693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:52.235397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:52.239301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:52.240146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 647/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:52.242714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.260785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.340898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2605d-a930-45e8-88b5-db91714b324e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.373363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.374028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.374313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.374591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.375305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:52.375614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.377065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.382035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 652/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:52.388762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.419677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.486325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662189e0-06ae-42a6-a858-7ea9f2b50ff7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.519260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.519911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.520200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.520478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.521295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] RBAC: Adding query filter params (interface=public, service_id=0902b125a80c4b129a98b662358b6ee3, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:52.521608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.522962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528706-bacc-482f-a156-820f6bd97e25 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.527871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 648/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/endpoints?service_id=0902b125a80c4b129a98b662358b6ee3&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:52.533603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.615024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.632538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9ac6f-062b-4d52-9479-f7053deb5f67 None admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.664642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.665328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.665611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.665889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.666569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.667930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67fc21-a87b-48c1-8c1a-0918683a0d6c None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.674470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 653/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:54.692304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ad4-5072-4546-8424-c07b1c2c8825 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.692883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ad4-5072-4546-8424-c07b1c2c8825 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.692981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ad4-5072-4546-8424-c07b1c2c8825 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.694285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 649/1302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:54.699896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.700341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.700448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.717062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:54.718242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:54.783913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 654/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:54.806816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8ad4-5072-4546-8424-c07b1c2c8825 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:54.899059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:54.906232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8ad4-5072-4546-8424-c07b1c2c8825 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:54.939081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:54.939888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.940180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.940461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.941153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:54.942714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:54.954677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:54.955849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jul 05 12:42:54.956761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 650/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:54.961894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.041005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.063738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f64a34-25bf-4ccd-93ae-5040088785a5 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.098299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.098970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.099256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.099536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] PATH_INFO: `/v3/services` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.100278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:55.100622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.102048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93ab7a-8081-46e1-8105-a0ffb54e9c30 None admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.107283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 655/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 5 12:42:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:55.113394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.210087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a446d-ab47-4d43-ae0e-4a7a810f255f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.243271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.243950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.244258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.244533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.245334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.247475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99001127-7787-4bef-ad80-60616fe940b5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.320131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 651/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:05.104103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=30 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:05.315702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:04.376055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab210-d3ed-4b57-aded-d77f5a762ca5 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:04.376591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab210-d3ed-4b57-aded-d77f5a762ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:04.376591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab210-d3ed-4b57-aded-d77f5a762ca5 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:04.383366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50234-d469-48bb-bbd6-f3a751c5b19d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:04.383826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50234-d469-48bb-bbd6-f3a751c5b19d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:04.383911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50234-d469-48bb-bbd6-f3a751c5b19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:04.387302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 656/1307] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:04.461235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5df50234-d469-48bb-bbd6-f3a751c5b19d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:04.462458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5df50234-d469-48bb-bbd6-f3a751c5b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:04.579451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 652/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:04.653073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:04.653435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:04.653867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:04.655550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 657/1309] 10.222.0.25 () {54 vars in 964 bytes} [Tue Jul 5 12:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:04.661847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa31-8fdd-4d12-ac04-1b14bdd3c626 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:04.662241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa31-8fdd-4d12-ac04-1b14bdd3c626 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:04.662489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa31-8fdd-4d12-ac04-1b14bdd3c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:04.797745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5464fa31-8fdd-4d12-ac04-1b14bdd3c626 None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:04.798963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5464fa31-8fdd-4d12-ac04-1b14bdd3c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:04.821770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:04.897131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 653/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Jul 5 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:04.907969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:04.909804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:05.069038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38480d9c-8e66-44cb-ae29-29aa3bcf101c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:05.156332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:05.156967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:05.157259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:05.157545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:05.159410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:05.220113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:05.281186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:05.282778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b56af5-97d4-4a3d-af7d-7832865d7b35 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:05.304425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 658/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:07.733895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:07.734503 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:07.734503 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:07.735817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 654/1312] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:07.741443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204bf4-beae-4efd-b3af-8f0fc8f15bf6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:07.741872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204bf4-beae-4efd-b3af-8f0fc8f15bf6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:07.742006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204bf4-beae-4efd-b3af-8f0fc8f15bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:07.821831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0d204bf4-beae-4efd-b3af-8f0fc8f15bf6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:07.823021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0d204bf4-beae-4efd-b3af-8f0fc8f15bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:07.918450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 659/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:07.956784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:07.958361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:08.073639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac742e81-20c9-4828-8599-2582f83610c9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:08.152883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:08.155788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:08.156461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:08.156775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:08.157058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:08.158784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:08.269215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:08.270644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a53b-ae8a-4349-b257-89b47a6937eb service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:08.288257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 655/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:11.033601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a72a-d823-40f1-b4f2-391fec056118 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:11.034032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a72a-d823-40f1-b4f2-391fec056118 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:11.034157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a72a-d823-40f1-b4f2-391fec056118 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:11.035571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 660/1315] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:11.040660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86abaf-f9c6-4754-91fc-79c73741df87 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:11.041055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86abaf-f9c6-4754-91fc-79c73741df87 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:11.041240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86abaf-f9c6-4754-91fc-79c73741df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:11.117029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3f86abaf-f9c6-4754-91fc-79c73741df87 None None] MFA Rules not processed for user `7ead7d199ae44c578a5f8d7af3148e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:11.118257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3f86abaf-f9c6-4754-91fc-79c73741df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:11.168746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:11.211700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 656/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:11.266476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:11.266768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:11.267053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:11.268442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 661/1317] 10.222.0.25 () {54 vars in 964 bytes} [Tue Jul 5 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:11.274235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a4ed-bc92-486c-aa50-806ab9cece30 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:11.274469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a4ed-bc92-486c-aa50-806ab9cece30 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:11.274753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a4ed-bc92-486c-aa50-806ab9cece30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:11.349387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a9e1a4ed-bc92-486c-aa50-806ab9cece30 None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:11.350633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a9e1a4ed-bc92-486c-aa50-806ab9cece30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:11.428118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 657/1318] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Jul 5 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:11.437439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:11.449398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:11.449398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:11.542631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe2ff-23df-43e1-87b5-d59804efed0a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:11.614996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:11.615638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:11.615928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:11.616252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:11.617912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:11.680200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:11.726701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:11.728140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ed14-8b9b-49c2-9031-0db6ba323bc6 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:11.746611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 662/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:15.053746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:15.054238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:15.054336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:15.055707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 658/1320] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:15.060950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028564-658b-4f0b-bfc4-bba477d7cd11 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:15.061344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028564-658b-4f0b-bfc4-bba477d7cd11 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:15.061513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028564-658b-4f0b-bfc4-bba477d7cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:15.126293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-61028564-658b-4f0b-bfc4-bba477d7cd11 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:15.127499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-61028564-658b-4f0b-bfc4-bba477d7cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:15.223094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 663/1321] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:15.260983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:15.263306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:15.312362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:15.364207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8cac-47c8-4b01-96d7-0dd89792ea6e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:15.435796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:15.436443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:15.436764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:15.437040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:15.438682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:15.532134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:15.545205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:15.546640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb633-d5e2-445e-9537-5aba165e0028 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:15.564768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 659/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:18.840109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:18.841086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:18.841086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:18.842188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 664/1323] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:18.847376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70279f-764a-47fc-8bf0-0300cc801eaf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:18.847799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70279f-764a-47fc-8bf0-0300cc801eaf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:18.847939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70279f-764a-47fc-8bf0-0300cc801eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:18.915380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8b70279f-764a-47fc-8bf0-0300cc801eaf None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:18.916586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8b70279f-764a-47fc-8bf0-0300cc801eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:19.015104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 660/1324] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:19.051252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:19.052898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:19.072459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:19.169740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df202d6-5b20-47bb-8365-ed9fbd27d41c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:19.248132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:19.248883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:19.249174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:19.249457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:19.251116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:19.325466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:19.364822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:19.366322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8130e7-06d6-4fee-a504-95855d8c4ace service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:19.384879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 665/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:21.465594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:21.466147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:21.466147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:21.467514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 661/1326] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:21.473013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20af0-8abd-4045-abcf-349539f35840 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:21.473413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20af0-8abd-4045-abcf-349539f35840 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:21.473585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20af0-8abd-4045-abcf-349539f35840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:21.538651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-32d20af0-8abd-4045-abcf-349539f35840 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:21.539879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-32d20af0-8abd-4045-abcf-349539f35840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:21.638707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 666/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:21.674304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:21.675904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:21.736048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:21.778774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae290-b059-439b-bd6c-23cffabff18d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:21.850757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:21.851411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:21.851695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:21.851973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:21.853685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:21.966267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:21.968340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:21.969867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202f5eb-723c-4073-a0f0-84d0110c9ecd service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:21.992643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 662/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:24.094932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:24.095615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:24.095615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:24.097129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 667/1329] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:24.102939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274b60-ed7d-477d-99ff-d20348b22d6c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:24.103493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274b60-ed7d-477d-99ff-d20348b22d6c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:24.103603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274b60-ed7d-477d-99ff-d20348b22d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:24.169596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bb274b60-ed7d-477d-99ff-d20348b22d6c None None] MFA Rules not processed for user `7ead7d199ae44c578a5f8d7af3148e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:24.170812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bb274b60-ed7d-477d-99ff-d20348b22d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:24.265777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 663/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:24.304086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:24.305665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:24.337644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:24.415320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81ac4-3b3d-4e92-b310-9c4e1537db69 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:24.491754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:24.492416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:24.492748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:24.493018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:24.494656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:24.575898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:24.608820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:24.610268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0139ae-bbe8-4533-a06e-ff682bb71ff6 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:24.629464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 668/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:27.219061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:27.219586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:27.219586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:27.221021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 664/1332] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:27.226170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db542d0-e723-4e91-a7a2-291f91ca950a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:27.226598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db542d0-e723-4e91-a7a2-291f91ca950a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:27.226735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db542d0-e723-4e91-a7a2-291f91ca950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:27.291543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0db542d0-e723-4e91-a7a2-291f91ca950a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:27.292664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0db542d0-e723-4e91-a7a2-291f91ca950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:27.388234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 669/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:27.423582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:27.425144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:27.494663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:27.528480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee3e26-723d-4dde-aa77-482ae6f99710 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:27.681400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:27.681980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:27.682267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:27.682568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:27.684774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:27.791886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:27.793877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bbdd6-239c-49d2-a4c2-ea48f64d6f14 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:27.803526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:27.813657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 665/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:29.873648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:29.874184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:29.874184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:29.875576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 670/1335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:29.880656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2cbc-22a6-4986-bd09-1e95f2f31462 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:29.881090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2cbc-22a6-4986-bd09-1e95f2f31462 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:29.881241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2cbc-22a6-4986-bd09-1e95f2f31462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:29.944810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-298a2cbc-22a6-4986-bd09-1e95f2f31462 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:29.946017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-298a2cbc-22a6-4986-bd09-1e95f2f31462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:30.041113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 666/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:30.081946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:30.083492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:30.123985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:30.187327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776b34-3bec-4559-b23f-90e3c445f96c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:30.258559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:30.259211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:30.259498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:30.259777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:30.261446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:30.341932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:30.367382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:30.368849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0839b37-3d50-443f-b79d-2cf0a6c5b166 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:30.387677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 671/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:33.174459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:33.175018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:33.175018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:33.176370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 667/1338] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:33.181543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d331-bd57-4468-9d48-2882de1c6831 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:33.181924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d331-bd57-4468-9d48-2882de1c6831 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:33.182105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d331-bd57-4468-9d48-2882de1c6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:33.247132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-33a0d331-bd57-4468-9d48-2882de1c6831 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:33.248339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-33a0d331-bd57-4468-9d48-2882de1c6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:33.342615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 672/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:33.378628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:33.380182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:33.455186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:33.483900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd52672-cc78-4dea-9a54-b3b704f04935 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:33.556777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:33.557441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:33.557726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:33.558000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:33.559791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:33.667633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:33.669980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99c6d6-6624-4ede-8514-a20d6abd6bf7 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:33.688162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 668/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:37.970312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:37.970891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:37.970891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:37.972809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 673/1341] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:37.977581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348907-e405-4f6e-a572-7f6360042f0d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:37.978044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348907-e405-4f6e-a572-7f6360042f0d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:37.978163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348907-e405-4f6e-a572-7f6360042f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:37.985441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:38.059114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3b348907-e405-4f6e-a572-7f6360042f0d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:38.073163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3b348907-e405-4f6e-a572-7f6360042f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:38.178471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 669/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:38.218449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:38.220627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:38.275700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:38.323289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3c1b-bd99-439a-bd7a-e52107a5dfd1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:38.327351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:38.328020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:38.328349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:38.328616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:38.337895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:38.339361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f645e8-6473-46e5-b095-c45a6e1357ad service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:38.349152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 674/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:41.713631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ebb9-0650-4a3c-b463-cf982b457174 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:41.714169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ebb9-0650-4a3c-b463-cf982b457174 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:41.714325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ebb9-0650-4a3c-b463-cf982b457174 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:41.716221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 670/1344] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:41.721572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde74a1-46c2-4bb8-b9d0-d94ddd3a1570 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:41.721969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde74a1-46c2-4bb8-b9d0-d94ddd3a1570 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:41.722256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde74a1-46c2-4bb8-b9d0-d94ddd3a1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:41.750192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cbde74a1-46c2-4bb8-b9d0-d94ddd3a1570 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:41.751381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cbde74a1-46c2-4bb8-b9d0-d94ddd3a1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:41.834093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 675/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:41.871834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ebb9-0650-4a3c-b463-cf982b457174 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:41.882601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ebb9-0650-4a3c-b463-cf982b457174 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:41.886177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:41.886877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:41.887161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:41.887435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:41.897117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:41.898549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff4ebf-95a1-4c88-8bf2-6aec5117e762 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:41.908470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 671/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:46.480257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a109-145c-40ce-b5b3-1793ded2e9e4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:46.480777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a109-145c-40ce-b5b3-1793ded2e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:46.480886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a109-145c-40ce-b5b3-1793ded2e9e4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:46.483284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 676/1347] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:46.489116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454501e3-98e5-4487-8b1c-df4f4f759ecb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:46.489591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454501e3-98e5-4487-8b1c-df4f4f759ecb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:46.489714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454501e3-98e5-4487-8b1c-df4f4f759ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:46.509752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-454501e3-98e5-4487-8b1c-df4f4f759ecb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:46.511134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-454501e3-98e5-4487-8b1c-df4f4f759ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:46.523987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 672/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:46.564187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a109-145c-40ce-b5b3-1793ded2e9e4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:50:46.576106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a109-145c-40ce-b5b3-1793ded2e9e4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:50:46.584294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:50:46.585036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:46.585469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:46.585758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:46.596041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:50:46.597558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541463e3-6be4-4f75-ada8-f8edb1bf5f26 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:50:46.613198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 677/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:50:51.601609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c493-e9c2-4377-b357-a7149b17107f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:51.602128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c493-e9c2-4377-b357-a7149b17107f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:51.602224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c493-e9c2-4377-b357-a7149b17107f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:51.603864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 673/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:51.612240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86f53-b31f-42f6-a6b7-42df570a577c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:51.612790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86f53-b31f-42f6-a6b7-42df570a577c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:51.613117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86f53-b31f-42f6-a6b7-42df570a577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:51.684596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-23b86f53-b31f-42f6-a6b7-42df570a577c None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:51.685832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-23b86f53-b31f-42f6-a6b7-42df570a577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:51.713754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:51.768878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 678/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:55.937439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437b32-7360-4b19-a600-74d0c957f9e8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:55.937993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437b32-7360-4b19-a600-74d0c957f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:55.938248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437b32-7360-4b19-a600-74d0c957f9e8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:55.939904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 674/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:55.946464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c212-dd53-4e39-9efa-9f280c2001df None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:55.946905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c212-dd53-4e39-9efa-9f280c2001df None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:55.947218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c212-dd53-4e39-9efa-9f280c2001df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:55.967148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-fcb6c212-dd53-4e39-9efa-9f280c2001df None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:55.968510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fcb6c212-dd53-4e39-9efa-9f280c2001df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:55.977611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 679/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:50:56.505112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=72 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:50:57.451366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58125-bffb-4f75-bc28-182a3a540ad9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:57.451977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58125-bffb-4f75-bc28-182a3a540ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:57.451977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58125-bffb-4f75-bc28-182a3a540ad9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:57.453239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 675/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:50:57.458448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40caba-43ad-4e16-bb12-3c3a8d73e8ac None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:50:57.458925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40caba-43ad-4e16-bb12-3c3a8d73e8ac None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:50:57.459023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40caba-43ad-4e16-bb12-3c3a8d73e8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:50:57.477569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0e40caba-43ad-4e16-bb12-3c3a8d73e8ac None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:50:57.478787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0e40caba-43ad-4e16-bb12-3c3a8d73e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:50:57.488908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 680/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:01.143416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc56c1-6931-4e1f-8ab9-7d3f96b5fac8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:01.143917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc56c1-6931-4e1f-8ab9-7d3f96b5fac8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:01.143917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc56c1-6931-4e1f-8ab9-7d3f96b5fac8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:01.145289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 676/1356] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:01.151189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f963cc-a7bd-453e-9186-976f6d90b43a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:01.151676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f963cc-a7bd-453e-9186-976f6d90b43a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:01.151971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f963cc-a7bd-453e-9186-976f6d90b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:01.176306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f9f963cc-a7bd-453e-9186-976f6d90b43a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:01.177710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f9f963cc-a7bd-453e-9186-976f6d90b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:01.186458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 681/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:01.245773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e51d8-9460-4de2-8915-1c2591e839cc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:01.246738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e51d8-9460-4de2-8915-1c2591e839cc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:01.247339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e51d8-9460-4de2-8915-1c2591e839cc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:01.249490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 677/1358] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 5 12:51:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:01.259350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9443dc-5e5d-4d53-bd41-f9eb29a55d27 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:01.262224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9443dc-5e5d-4d53-bd41-f9eb29a55d27 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:01.262224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9443dc-5e5d-4d53-bd41-f9eb29a55d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:01.311878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-be9443dc-5e5d-4d53-bd41-f9eb29a55d27 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:01.313213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-be9443dc-5e5d-4d53-bd41-f9eb29a55d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:01.406540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 682/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 5 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:01.415583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e51d8-9460-4de2-8915-1c2591e839cc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:01.431506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e51d8-9460-4de2-8915-1c2591e839cc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:01.437741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:01.438401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:01.438688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:01.438967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:01.448087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:01.449805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190b1b2-218b-42f7-9c43-a350aca0d1ad service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:01.460933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 678/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:51:03.703274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f81f-b074-42dc-b0ba-1db8d3fc7890 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:03.703803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f81f-b074-42dc-b0ba-1db8d3fc7890 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:03.704155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f81f-b074-42dc-b0ba-1db8d3fc7890 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:03.705916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 683/1361] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:03.711284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82133e-6109-4018-b969-d795b132731f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:03.712067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82133e-6109-4018-b969-d795b132731f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:03.712506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82133e-6109-4018-b969-d795b132731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:03.732606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6d82133e-6109-4018-b969-d795b132731f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:03.734104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6d82133e-6109-4018-b969-d795b132731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:03.743341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 679/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:03.790911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f81f-b074-42dc-b0ba-1db8d3fc7890 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:03.805921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f81f-b074-42dc-b0ba-1db8d3fc7890 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:03.811566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:03.812223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:03.812513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:03.812832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:03.821430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:03.823037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a63f84-39b4-48dd-9966-1c239ab01569 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:03.833753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 684/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:06.413734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ed-3cd1-4bfe-b95f-0f841c805d12 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:06.414251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ed-3cd1-4bfe-b95f-0f841c805d12 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:06.414346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f421ed-3cd1-4bfe-b95f-0f841c805d12 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:06.415673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 680/1364] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:06.421524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256a8a-db5f-4ea9-a18c-91d0249ebce1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:06.421962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256a8a-db5f-4ea9-a18c-91d0249ebce1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:06.422091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256a8a-db5f-4ea9-a18c-91d0249ebce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:06.441042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-31256a8a-db5f-4ea9-a18c-91d0249ebce1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:06.442251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-31256a8a-db5f-4ea9-a18c-91d0249ebce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:06.450974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 685/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:06.496618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da329-4385-43a9-a3d3-539c652014bb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:06.496941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da329-4385-43a9-a3d3-539c652014bb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:06.497222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da329-4385-43a9-a3d3-539c652014bb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:06.498588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 681/1366] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 5 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:06.503972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a791a4-ad60-47a6-8959-03ff84a81fb1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:06.504532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a791a4-ad60-47a6-8959-03ff84a81fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:06.504857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a791a4-ad60-47a6-8959-03ff84a81fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:06.532131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e6a791a4-ad60-47a6-8959-03ff84a81fb1 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:06.532131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e6a791a4-ad60-47a6-8959-03ff84a81fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:06.538953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 686/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 5 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:06.548187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da329-4385-43a9-a3d3-539c652014bb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:06.562685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da329-4385-43a9-a3d3-539c652014bb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:06.568103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:06.568770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:06.569054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:06.569328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:06.577544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:06.579141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa405-1160-4079-998e-38b991ff7e0f service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:06.588624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 682/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:08.912474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40aa1-d1dc-4c2d-9d67-bb2353b869c8 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:08.913474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40aa1-d1dc-4c2d-9d67-bb2353b869c8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:08.913953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40aa1-d1dc-4c2d-9d67-bb2353b869c8 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:08.915499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 687/1369] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:08.921302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216881e3-c6c7-4cb0-bb25-2a270503d9b0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:08.922367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216881e3-c6c7-4cb0-bb25-2a270503d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:08.922928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216881e3-c6c7-4cb0-bb25-2a270503d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:08.942690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-216881e3-c6c7-4cb0-bb25-2a270503d9b0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:08.944185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-216881e3-c6c7-4cb0-bb25-2a270503d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:08.954225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 683/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:51:08.998748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c40aa1-d1dc-4c2d-9d67-bb2353b869c8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:09.016710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c40aa1-d1dc-4c2d-9d67-bb2353b869c8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:09.029246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:09.033553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.033553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.033553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.039627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:09.041317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d4403-5bc7-4947-87bc-b969794822e9 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:09.052016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 688/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:09.272608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa65e4a-9c3c-4469-97b5-4f510c4156c5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.277972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa65e4a-9c3c-4469-97b5-4f510c4156c5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.277972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa65e4a-9c3c-4469-97b5-4f510c4156c5 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.277972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 684/1372] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:09.281427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd392d-f627-491a-9681-473a6f9143f5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.281723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd392d-f627-491a-9681-473a6f9143f5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.282033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd392d-f627-491a-9681-473a6f9143f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.302916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2edd392d-f627-491a-9681-473a6f9143f5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:09.304166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2edd392d-f627-491a-9681-473a6f9143f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:09.316866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 689/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:09.659513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4398f-d51c-4722-a0be-31d35b40579b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.659513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4398f-d51c-4722-a0be-31d35b40579b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.659513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4398f-d51c-4722-a0be-31d35b40579b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.662193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 685/1374] 10.222.0.25 () {54 vars in 963 bytes} [Tue Jul 5 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:09.665860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9622-dd27-4e3e-923b-f5b2fad059b2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.666150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9622-dd27-4e3e-923b-f5b2fad059b2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.666446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9622-dd27-4e3e-923b-f5b2fad059b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.674598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:51:09.719240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3fcd9622-dd27-4e3e-923b-f5b2fad059b2 None None] MFA Rules not processed for user `4c4dafecd5b64ac6bbc26ac0a236ebfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:09.720613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3fcd9622-dd27-4e3e-923b-f5b2fad059b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:09.788296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 690/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Jul 5 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:09.796347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4398f-d51c-4722-a0be-31d35b40579b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:09.807381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4398f-d51c-4722-a0be-31d35b40579b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:09.811178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:09.811926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:09.812310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:09.812709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:09.822273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:09.824429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e756e30-01f3-4e6b-b3b3-6c246dd28d2c service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:09.834985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 686/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:11.280078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a8bf-338f-4783-a792-29c2fda0f404 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:11.280591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a8bf-338f-4783-a792-29c2fda0f404 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:11.280591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a8bf-338f-4783-a792-29c2fda0f404 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:11.282081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 691/1377] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:11.287464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff75f-16c9-4146-b370-36eb41c8b968 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:11.287894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff75f-16c9-4146-b370-36eb41c8b968 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:11.288010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff75f-16c9-4146-b370-36eb41c8b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:11.306970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f10ff75f-16c9-4146-b370-36eb41c8b968 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:11.308902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f10ff75f-16c9-4146-b370-36eb41c8b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:11.317577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 687/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:11.361640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a8bf-338f-4783-a792-29c2fda0f404 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:11.378409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a8bf-338f-4783-a792-29c2fda0f404 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:11.384655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:11.385648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:11.385940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:11.386274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:11.398518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:11.400160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2a42-6ade-440b-b355-e61cf67ab68e service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:11.410483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 692/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:13.688814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f1-4485-49c8-83e3-c561a4875db2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:13.689638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f1-4485-49c8-83e3-c561a4875db2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:13.690071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f1-4485-49c8-83e3-c561a4875db2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:13.692468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 688/1380] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:13.696714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9268-cdcf-457b-84ce-8e2adb3682ea None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:13.697110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9268-cdcf-457b-84ce-8e2adb3682ea None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:13.697275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9268-cdcf-457b-84ce-8e2adb3682ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:13.714958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9fea9268-cdcf-457b-84ce-8e2adb3682ea None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:13.716281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9fea9268-cdcf-457b-84ce-8e2adb3682ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:13.724158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 693/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:13.769511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac5f1-4485-49c8-83e3-c561a4875db2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:13.784380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac5f1-4485-49c8-83e3-c561a4875db2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:13.789816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:13.790461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:13.790922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:13.791196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:13.800406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:13.802948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e900c-2ba6-4b64-93a6-98752ac6cc09 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:13.814093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 689/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:16.038565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c78-6800-451d-99e3-57771dd058dd None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:16.039084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c78-6800-451d-99e3-57771dd058dd None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:16.039177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c78-6800-451d-99e3-57771dd058dd None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:16.047383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 694/1383] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:16.047506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80af5a-4340-4de1-872a-796ef9e0608b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:16.047506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80af5a-4340-4de1-872a-796ef9e0608b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:16.047506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80af5a-4340-4de1-872a-796ef9e0608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:16.064419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dc80af5a-4340-4de1-872a-796ef9e0608b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:16.065674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dc80af5a-4340-4de1-872a-796ef9e0608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:16.074283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 690/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:16.115104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2c78-6800-451d-99e3-57771dd058dd None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:16.130617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2c78-6800-451d-99e3-57771dd058dd None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:16.136776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:16.137676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:16.138018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:16.138245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:16.146894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:16.148524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fdbdf-8056-41df-a528-659a0cee9caf service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:16.158707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 695/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:18.225797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d55d6-438a-4c53-8723-b20ce439aa9f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:18.226444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d55d6-438a-4c53-8723-b20ce439aa9f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:18.226444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d55d6-438a-4c53-8723-b20ce439aa9f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:18.227917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 691/1386] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:18.233736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aced2-1ee9-4ef9-b282-2ac6ca016afe None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:18.234226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aced2-1ee9-4ef9-b282-2ac6ca016afe None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:18.234344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aced2-1ee9-4ef9-b282-2ac6ca016afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:18.252945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-386aced2-1ee9-4ef9-b282-2ac6ca016afe None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:18.254146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-386aced2-1ee9-4ef9-b282-2ac6ca016afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:18.262220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 696/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:18.309258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d55d6-438a-4c53-8723-b20ce439aa9f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:18.325247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d55d6-438a-4c53-8723-b20ce439aa9f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:18.331258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:18.331915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:18.332258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:18.332520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:18.341605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:18.343240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f3e14-d408-4301-be1c-d6b80a5c36d0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:18.353273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 692/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:51:20.554592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c01d5-f903-46c2-bbb9-f98c3f878663 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:20.555147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c01d5-f903-46c2-bbb9-f98c3f878663 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:20.555248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c01d5-f903-46c2-bbb9-f98c3f878663 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:20.556633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 697/1389] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:51:20.562529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79139-c3ea-4f3f-94b7-9e7bbb490281 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:20.562981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79139-c3ea-4f3f-94b7-9e7bbb490281 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:20.563085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79139-c3ea-4f3f-94b7-9e7bbb490281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:20.581551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-56b79139-c3ea-4f3f-94b7-9e7bbb490281 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:20.582780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-56b79139-c3ea-4f3f-94b7-9e7bbb490281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:20.593761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 693/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:51:20.638428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c01d5-f903-46c2-bbb9-f98c3f878663 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:20.659561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c01d5-f903-46c2-bbb9-f98c3f878663 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:20.668998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:20.669990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:20.670415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:20.670800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:20.683472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:20.686028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9f03-441b-461d-9bc4-00b272d6fecf service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:20.699276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 698/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:51:22.991448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a38-b43a-4600-b4dc-f6957d8159de None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:22.991998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a38-b43a-4600-b4dc-f6957d8159de None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:22.992222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a38-b43a-4600-b4dc-f6957d8159de None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:22.994144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 694/1392] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:23.000023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cf8d-ce2e-4e35-920f-5c4fd93ad289 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:23.000455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cf8d-ce2e-4e35-920f-5c4fd93ad289 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:23.001266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cf8d-ce2e-4e35-920f-5c4fd93ad289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:23.023265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2fd0cf8d-ce2e-4e35-920f-5c4fd93ad289 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:23.023265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2fd0cf8d-ce2e-4e35-920f-5c4fd93ad289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:23.031511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 699/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:51:23.076586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e2a38-b43a-4600-b4dc-f6957d8159de None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:23.093524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e2a38-b43a-4600-b4dc-f6957d8159de None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:23.100094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:23.100969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:23.101336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:23.101690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:23.112783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:23.115182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfc2c8-5fa2-4d9e-9148-23418e105f0b service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:23.128707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 695/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:25.332634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a6c34-5845-4268-aff4-ebfcee359dcb None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.333251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a6c34-5845-4268-aff4-ebfcee359dcb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.333251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a6c34-5845-4268-aff4-ebfcee359dcb None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.334494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 700/1395] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:25.340387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847bdec-f874-4c71-81dc-30471c73f7e0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.340835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847bdec-f874-4c71-81dc-30471c73f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.340974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847bdec-f874-4c71-81dc-30471c73f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.360167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1847bdec-f874-4c71-81dc-30471c73f7e0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:25.361407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1847bdec-f874-4c71-81dc-30471c73f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:25.369455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 696/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:25.402740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd19fa-e42c-4825-ac03-6bfe8707cead None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.403029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd19fa-e42c-4825-ac03-6bfe8707cead None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.403363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd19fa-e42c-4825-ac03-6bfe8707cead None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.404723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 701/1397] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:25.409969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d0e-82be-4e58-8310-835217ae6934 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.410269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d0e-82be-4e58-8310-835217ae6934 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.410554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05d0e-82be-4e58-8310-835217ae6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.412962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd19fa-e42c-4825-ac03-6bfe8707cead None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:25.427723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd19fa-e42c-4825-ac03-6bfe8707cead None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:25.429293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-afa05d0e-82be-4e58-8310-835217ae6934 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:25.430514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-afa05d0e-82be-4e58-8310-835217ae6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:25.433423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:25.434058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.434346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.434626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.438996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 697/1398] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:25.442993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:25.444568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1687-19a8-4f3d-b471-85ad329e9329 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:25.454487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 702/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:51:25.495844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5701-102c-4b0b-a8d6-758bccfe3a30 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.496149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5701-102c-4b0b-a8d6-758bccfe3a30 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.496430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5701-102c-4b0b-a8d6-758bccfe3a30 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.498001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 698/1400] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 5 12:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:25.502943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344e0b-30cd-4fab-a837-eae4c46802c4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.503245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344e0b-30cd-4fab-a837-eae4c46802c4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.503544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344e0b-30cd-4fab-a837-eae4c46802c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.555202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-29344e0b-30cd-4fab-a837-eae4c46802c4 None None] MFA Rules not processed for user `387a99329ad748118d233f4a2c644c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:25.556502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-29344e0b-30cd-4fab-a837-eae4c46802c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:25.598060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:51:25.618528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 703/1401] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 5 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:25.626869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5701-102c-4b0b-a8d6-758bccfe3a30 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:25.637758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5701-102c-4b0b-a8d6-758bccfe3a30 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:25.641631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:25.642285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:25.642572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:25.642851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:25.653505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:25.654992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dd651-8047-456c-91eb-26cc5a3b7f25 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:25.665954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 699/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:26.577343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07267f8-b38f-46a7-afed-02db112ffed5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:26.581057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07267f8-b38f-46a7-afed-02db112ffed5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:26.581057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07267f8-b38f-46a7-afed-02db112ffed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:26.626784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b07267f8-b38f-46a7-afed-02db112ffed5 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:26.628026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b07267f8-b38f-46a7-afed-02db112ffed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:26.691379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 704/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:26.738357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7441a-f8e8-48e9-826e-67823590a978 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:26.739086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7441a-f8e8-48e9-826e-67823590a978 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:26.739196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7441a-f8e8-48e9-826e-67823590a978 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:26.740683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 700/1404] 10.222.0.25 () {54 vars in 942 bytes} [Tue Jul 5 12:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:26.748244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301278-d93c-4751-bf25-8ef0e6f59b61 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:26.748600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301278-d93c-4751-bf25-8ef0e6f59b61 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:26.748985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301278-d93c-4751-bf25-8ef0e6f59b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:26.796446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a5301278-d93c-4751-bf25-8ef0e6f59b61 None None] MFA Rules not processed for user `6e7088e558ef4e778441a295dbf23500`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:26.797699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a5301278-d93c-4751-bf25-8ef0e6f59b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:26.868850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 705/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Tue Jul 5 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:26.878789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7441a-f8e8-48e9-826e-67823590a978 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:26.887224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=64 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:51:26.893474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7441a-f8e8-48e9-826e-67823590a978 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:26.899827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:26.899827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:26.899827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:26.899827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:26.908571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:26.910198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a782b-630f-4c87-a2f7-fdd1b6c3cb36 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:26.918701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 701/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 12:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:51:27.658991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d626f1-05c2-44fb-9d7a-1d01a6511b11 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:27.659511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d626f1-05c2-44fb-9d7a-1d01a6511b11 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:27.659511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d626f1-05c2-44fb-9d7a-1d01a6511b11 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:27.664622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 706/1407] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:51:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:27.666026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9cee8-48fc-423b-a6a7-358f59255c7e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:27.666399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9cee8-48fc-423b-a6a7-358f59255c7e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:27.666757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9cee8-48fc-423b-a6a7-358f59255c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:27.687499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ada9cee8-48fc-423b-a6a7-358f59255c7e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:27.688875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ada9cee8-48fc-423b-a6a7-358f59255c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:27.697979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 702/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:51:27.743363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d626f1-05c2-44fb-9d7a-1d01a6511b11 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:27.759806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d626f1-05c2-44fb-9d7a-1d01a6511b11 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:27.766196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:27.766851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:27.767138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:27.767445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:27.777134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:27.778882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1020d4-355a-4d98-a08f-b751c3bca3e3 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:27.789107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 707/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:37.684635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:51:37.785126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:51:51.173648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7b7ef-41f7-4634-9c2d-366f0e9b679e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:51.174237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7b7ef-41f7-4634-9c2d-366f0e9b679e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:51.174237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7b7ef-41f7-4634-9c2d-366f0e9b679e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:51.175569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 703/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Jul 5 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:51.180784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368fc48-fdb1-48a0-a58a-f301929a9d10 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:51.181222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368fc48-fdb1-48a0-a58a-f301929a9d10 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:51.181377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368fc48-fdb1-48a0-a58a-f301929a9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:51.200289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1368fc48-fdb1-48a0-a58a-f301929a9d10 None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:51.201542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1368fc48-fdb1-48a0-a58a-f301929a9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:51.210088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 708/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 5 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:51.223752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa79-a53f-40d0-b775-9141e42773dc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:51.224065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa79-a53f-40d0-b775-9141e42773dc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:51.224347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa79-a53f-40d0-b775-9141e42773dc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:51.225743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 704/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Jul 5 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:51.230288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c112-fa09-4d69-9e9a-220472ae11d0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:51.230647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c112-fa09-4d69-9e9a-220472ae11d0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:51.230930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c112-fa09-4d69-9e9a-220472ae11d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:51.249451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2128c112-fa09-4d69-9e9a-220472ae11d0 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:51.250657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2128c112-fa09-4d69-9e9a-220472ae11d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:51.264888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 709/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 5 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:51:53.726980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7627db-0a6d-4ea9-85c6-1f61b5c87a07 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:53.727499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7627db-0a6d-4ea9-85c6-1f61b5c87a07 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:53.727625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7627db-0a6d-4ea9-85c6-1f61b5c87a07 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:53.728939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:53.734882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75444ed4-543a-409e-b41e-fc307c7ba8fa None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:53.739706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75444ed4-543a-409e-b41e-fc307c7ba8fa None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:53.739706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75444ed4-543a-409e-b41e-fc307c7ba8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:53.753620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-75444ed4-543a-409e-b41e-fc307c7ba8fa None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:53.754805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-75444ed4-543a-409e-b41e-fc307c7ba8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:53.762739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:53.806336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7627db-0a6d-4ea9-85c6-1f61b5c87a07 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:53.821501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7627db-0a6d-4ea9-85c6-1f61b5c87a07 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:53.827219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:53.831501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:53.831501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:53.831501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:53.836437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:53.838047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e824-fce4-4959-8488-c83fc7d1a119 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:53.847595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 706/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:51:54.774954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe515-7fd5-40c0-9c55-c5d15ce221aa None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:54.775801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe515-7fd5-40c0-9c55-c5d15ce221aa None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:54.775801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe515-7fd5-40c0-9c55-c5d15ce221aa None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:54.777508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:54.782725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd5137-32bc-41d3-9ed2-d4fa95e82eeb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:54.783145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd5137-32bc-41d3-9ed2-d4fa95e82eeb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:54.783282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd5137-32bc-41d3-9ed2-d4fa95e82eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:54.801226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-69cd5137-32bc-41d3-9ed2-d4fa95e82eeb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:54.802446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-69cd5137-32bc-41d3-9ed2-d4fa95e82eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:54.811411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:54.960833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfe515-7fd5-40c0-9c55-c5d15ce221aa None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:54.975120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfe515-7fd5-40c0-9c55-c5d15ce221aa None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:54.981048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:54.981695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:54.981982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:54.982262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:54.990639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:54.992222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d14a-c377-47a9-9ee6-d4cd91ec5f80 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:55.002219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 712/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:55.876969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb825d-13e8-4b95-869a-baf0dfece361 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:55.877565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb825d-13e8-4b95-869a-baf0dfece361 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:55.877565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb825d-13e8-4b95-869a-baf0dfece361 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:55.878879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:55.883876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a59296-5c05-44ae-a7dd-c96790c771fe None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:55.884339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a59296-5c05-44ae-a7dd-c96790c771fe None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:55.884446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a59296-5c05-44ae-a7dd-c96790c771fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:55.903651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-85a59296-5c05-44ae-a7dd-c96790c771fe None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:55.904914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-85a59296-5c05-44ae-a7dd-c96790c771fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:55.912650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:56.063488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb825d-13e8-4b95-869a-baf0dfece361 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:56.077927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb825d-13e8-4b95-869a-baf0dfece361 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:56.083212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:56.083842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:56.084123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:56.084396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:56.093165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:56.094808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59c0b1-c248-46ea-9018-eea7fe593b38 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:56.104564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 709/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:56.990372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810fd78-9310-4f41-bf3c-60bbc7417b86 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:56.990926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810fd78-9310-4f41-bf3c-60bbc7417b86 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:56.990926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810fd78-9310-4f41-bf3c-60bbc7417b86 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:56.992309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:56.997724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e65a-db3a-4d01-8d58-91dffe5924ec None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:56.998113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e65a-db3a-4d01-8d58-91dffe5924ec None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:56.998318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e65a-db3a-4d01-8d58-91dffe5924ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:57.016698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7687e65a-db3a-4d01-8d58-91dffe5924ec None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:57.017906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7687e65a-db3a-4d01-8d58-91dffe5924ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:57.025806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:57.175230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810fd78-9310-4f41-bf3c-60bbc7417b86 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:57.189970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810fd78-9310-4f41-bf3c-60bbc7417b86 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:57.195293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:57.195930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:57.196213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:57.196486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:57.205479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:57.207052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a2176-f333-468c-8929-875be1c91d7a service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:57.216594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 715/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:58.101036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593478b-c32c-4613-abe1-697e2345380a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:58.101589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593478b-c32c-4613-abe1-697e2345380a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:58.101589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593478b-c32c-4613-abe1-697e2345380a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:58.102962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:58.108481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44f9d-ed86-4af6-8399-e41d69f5a22b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:58.108970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44f9d-ed86-4af6-8399-e41d69f5a22b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:58.109077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec44f9d-ed86-4af6-8399-e41d69f5a22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:58.127707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2ec44f9d-ed86-4af6-8399-e41d69f5a22b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:58.128924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2ec44f9d-ed86-4af6-8399-e41d69f5a22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:58.136719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:58.284949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593478b-c32c-4613-abe1-697e2345380a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:58.299790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593478b-c32c-4613-abe1-697e2345380a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:58.305211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:58.305849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:58.306137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:58.306416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:58.314998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:58.316585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca91d-cfd3-4cfd-8a83-16cae1f3d401 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:58.326506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 712/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:51:59.201613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c87-df0d-48c4-9c95-08fd44733387 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:59.202183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c87-df0d-48c4-9c95-08fd44733387 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:59.202183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c87-df0d-48c4-9c95-08fd44733387 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:59.203512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:51:59.208304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8232-329d-4974-8024-a801875c610c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:59.208715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8232-329d-4974-8024-a801875c610c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:59.208895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8232-329d-4974-8024-a801875c610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:59.227079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-86ed8232-329d-4974-8024-a801875c610c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:51:59.228277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-86ed8232-329d-4974-8024-a801875c610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:51:59.236868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:51:59.387281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd55c87-df0d-48c4-9c95-08fd44733387 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:51:59.401405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd55c87-df0d-48c4-9c95-08fd44733387 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:51:59.407413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:51:59.408053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:51:59.408338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:51:59.408617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:51:59.416642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:51:59.418952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e639e-a3f3-4159-bb5d-47f75b1c773b service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:51:59.428203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 718/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:00.309249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f104-0f7a-498c-8ab7-9529489299fc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:00.309814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f104-0f7a-498c-8ab7-9529489299fc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:00.309814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f104-0f7a-498c-8ab7-9529489299fc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:00.311182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:00.316081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c898-4103-4af0-9f6b-d73f9e3dc571 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:00.316514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c898-4103-4af0-9f6b-d73f9e3dc571 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:00.316615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c898-4103-4af0-9f6b-d73f9e3dc571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:00.334853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2411c898-4103-4af0-9f6b-d73f9e3dc571 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:00.336040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2411c898-4103-4af0-9f6b-d73f9e3dc571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:00.343841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:00.494837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f104-0f7a-498c-8ab7-9529489299fc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:00.509679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f104-0f7a-498c-8ab7-9529489299fc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:00.515070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:00.515710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:00.515994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:00.516270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:00.524452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:00.526099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d9f4-0d2a-4b30-8300-00b27f946fcf service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:00.535482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 715/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:01.415292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c5ece-3eb8-4c80-a802-0e0a345e4e1b None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:01.415795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c5ece-3eb8-4c80-a802-0e0a345e4e1b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:01.415903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c5ece-3eb8-4c80-a802-0e0a345e4e1b None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:01.417906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:01.422887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69344ad-1013-4fd4-840b-7ecfdcb036b3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:01.423307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69344ad-1013-4fd4-840b-7ecfdcb036b3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:01.423448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69344ad-1013-4fd4-840b-7ecfdcb036b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:01.441980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a69344ad-1013-4fd4-840b-7ecfdcb036b3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:01.443182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a69344ad-1013-4fd4-840b-7ecfdcb036b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:01.451251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:01.602533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c5ece-3eb8-4c80-a802-0e0a345e4e1b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:01.618102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c5ece-3eb8-4c80-a802-0e0a345e4e1b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:01.623792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:01.624425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:01.624743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:01.625030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:01.633274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:01.634858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ead7a7-b143-495b-b658-e4b099a7eb2a service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:01.646035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 721/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:02.507755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da9f6-13bc-439e-abf4-1f8586efd4c1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:02.508187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da9f6-13bc-439e-abf4-1f8586efd4c1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:02.508317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da9f6-13bc-439e-abf4-1f8586efd4c1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:02.509728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:02.515312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f4c0f-94ce-4851-bfbe-824408c1c5f1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:02.515705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f4c0f-94ce-4851-bfbe-824408c1c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:02.515883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f4c0f-94ce-4851-bfbe-824408c1c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:02.533816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-050f4c0f-94ce-4851-bfbe-824408c1c5f1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:02.535012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-050f4c0f-94ce-4851-bfbe-824408c1c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:02.542867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:02.692181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da9f6-13bc-439e-abf4-1f8586efd4c1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:02.708312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da9f6-13bc-439e-abf4-1f8586efd4c1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:02.713858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:02.715109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:02.715399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:02.715680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:02.723778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:02.725399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702a35-c610-4a02-a929-d6a2b76ac0c0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:02.734925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 718/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:04.667049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf87a-5546-422d-9c79-54e374321b2f None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:04.667551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf87a-5546-422d-9c79-54e374321b2f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:04.667645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf87a-5546-422d-9c79-54e374321b2f None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:04.669005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:04.674260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967557-f38c-4a78-93fd-65148811f618 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:04.674721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967557-f38c-4a78-93fd-65148811f618 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:04.674822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967557-f38c-4a78-93fd-65148811f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:04.692632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-21967557-f38c-4a78-93fd-65148811f618 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:04.693843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-21967557-f38c-4a78-93fd-65148811f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:04.702159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:52:04.739965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf87a-5546-422d-9c79-54e374321b2f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:04.750956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf87a-5546-422d-9c79-54e374321b2f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:04.754416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:04.755050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:04.755331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:04.755604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:04.764971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:04.766415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2276397-65b1-42c1-a9ab-005b68957072 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:04.776014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 724/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:07.004797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62ebf-dd66-4c1a-a467-7d5b5155f2b1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:07.005328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62ebf-dd66-4c1a-a467-7d5b5155f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:07.005421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62ebf-dd66-4c1a-a467-7d5b5155f2b1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:07.006888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:07.013274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c983-c3a4-4a2f-a6d8-a01013a7c205 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:07.013749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c983-c3a4-4a2f-a6d8-a01013a7c205 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:07.013841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c983-c3a4-4a2f-a6d8-a01013a7c205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:07.032163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-8201c983-c3a4-4a2f-a6d8-a01013a7c205 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:07.033401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8201c983-c3a4-4a2f-a6d8-a01013a7c205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:07.041683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:07.080258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62ebf-dd66-4c1a-a467-7d5b5155f2b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:07.090848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62ebf-dd66-4c1a-a467-7d5b5155f2b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:07.094375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:07.095013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:07.095302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:07.095579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:07.105045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:07.106593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dbe50-1a69-4a4b-ac36-b5abf7c19a24 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:07.116247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 721/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:09.507989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e952-c944-4c73-bd8e-632d8379fdf0 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:09.508543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e952-c944-4c73-bd8e-632d8379fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:09.508659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e952-c944-4c73-bd8e-632d8379fdf0 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:09.509956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:09.515750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14997a-415e-4806-8267-355fe2e35394 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:09.516177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14997a-415e-4806-8267-355fe2e35394 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:09.516302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14997a-415e-4806-8267-355fe2e35394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:09.534312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9c14997a-415e-4806-8267-355fe2e35394 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:09.535514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9c14997a-415e-4806-8267-355fe2e35394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:09.543472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:09.581291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911e952-c944-4c73-bd8e-632d8379fdf0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:09.592661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911e952-c944-4c73-bd8e-632d8379fdf0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:09.596129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:09.596787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:09.597072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:09.597346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:09.606172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:09.607589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fe1d5-3960-41a2-8547-da95b5c84d02 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:09.617098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 727/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:11.782299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0491-a5eb-454f-8bff-e29eb453766c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:11.782936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0491-a5eb-454f-8bff-e29eb453766c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:11.782936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0491-a5eb-454f-8bff-e29eb453766c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:11.784305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:11.789606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1be47-ebfd-4764-be80-d23521281bbb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:11.790069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1be47-ebfd-4764-be80-d23521281bbb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:11.790171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1be47-ebfd-4764-be80-d23521281bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:11.810091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6ac1be47-ebfd-4764-be80-d23521281bbb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:11.811280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6ac1be47-ebfd-4764-be80-d23521281bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:11.818935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:11.857741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd0491-a5eb-454f-8bff-e29eb453766c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:11.868452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd0491-a5eb-454f-8bff-e29eb453766c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:11.872888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:11.873534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:11.873820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:11.874099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:11.883370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:11.884860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038b9a-3efe-49bd-b482-966c3d26006d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:11.894271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 724/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:14.008384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee7db7-8daa-4692-8198-040da4a61f15 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:14.012690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee7db7-8daa-4692-8198-040da4a61f15 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:14.012690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee7db7-8daa-4692-8198-040da4a61f15 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:14.012690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:14.017142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cc839-7152-418c-841b-e4a997795299 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:14.017568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cc839-7152-418c-841b-e4a997795299 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:14.017855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cc839-7152-418c-841b-e4a997795299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:14.036720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-923cc839-7152-418c-841b-e4a997795299 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:14.037927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-923cc839-7152-418c-841b-e4a997795299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:14.046030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:14.083772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee7db7-8daa-4692-8198-040da4a61f15 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:14.094892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee7db7-8daa-4692-8198-040da4a61f15 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:14.098379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:14.099019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:14.099305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:14.099583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:14.109371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:14.110791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a803-368b-4cd0-8d7d-b57e059bc80f service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:14.120800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 730/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:16.188653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514622c-4555-4870-8db0-95588e773e9c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:16.189229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514622c-4555-4870-8db0-95588e773e9c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:16.189229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514622c-4555-4870-8db0-95588e773e9c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:16.190618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:16.195755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6182d-7acd-4fda-8dbc-f8df1a96a2cc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:16.196174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6182d-7acd-4fda-8dbc-f8df1a96a2cc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:16.196302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6182d-7acd-4fda-8dbc-f8df1a96a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:16.214971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1ac6182d-7acd-4fda-8dbc-f8df1a96a2cc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:16.216434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1ac6182d-7acd-4fda-8dbc-f8df1a96a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:16.224065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:16.261932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514622c-4555-4870-8db0-95588e773e9c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:16.272739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514622c-4555-4870-8db0-95588e773e9c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:16.276314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:16.277619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:16.277908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:16.278187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:16.287364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:16.288979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e7992-9dc0-4607-a254-cbbef3dcfa1d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:16.298621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 727/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:18.407459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df6897-b901-4e0e-bc84-365f047c7292 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:18.407998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df6897-b901-4e0e-bc84-365f047c7292 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:18.407998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df6897-b901-4e0e-bc84-365f047c7292 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:18.409342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:18.414733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3e3c-06ee-4dd2-b7af-1548d1c74bd0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:18.415134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3e3c-06ee-4dd2-b7af-1548d1c74bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:18.415324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3e3c-06ee-4dd2-b7af-1548d1c74bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:18.421973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=70 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:18.434437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-016e3e3c-06ee-4dd2-b7af-1548d1c74bd0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:18.435637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-016e3e3c-06ee-4dd2-b7af-1548d1c74bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:18.443455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:18.479565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df6897-b901-4e0e-bc84-365f047c7292 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:18.485825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=73 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:18.492097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df6897-b901-4e0e-bc84-365f047c7292 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:18.496387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:18.496854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:18.497146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:18.497420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:18.506485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:18.507985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d2f06-59f3-4adc-b64d-a6a078558329 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:18.517987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 733/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:20.627504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f945-40fd-42ba-bd30-9ff8147baefb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:20.628053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f945-40fd-42ba-bd30-9ff8147baefb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:20.628053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f945-40fd-42ba-bd30-9ff8147baefb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:20.629462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:20.634545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96412-69b0-406d-8c6f-e53912a378d2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:20.634978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96412-69b0-406d-8c6f-e53912a378d2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:20.635112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96412-69b0-406d-8c6f-e53912a378d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:20.653685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a3b96412-69b0-406d-8c6f-e53912a378d2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:20.654876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a3b96412-69b0-406d-8c6f-e53912a378d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:20.662594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:20.700097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6f945-40fd-42ba-bd30-9ff8147baefb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:20.710552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6f945-40fd-42ba-bd30-9ff8147baefb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:20.714008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:20.715329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:20.715610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:20.715882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:20.724505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:20.725960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc0d6c-82ac-42d7-ba73-19a9c831593e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:20.735070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 730/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:52:22.818052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726838e-a289-441e-bc54-9c6332e7039e None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:22.818576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726838e-a289-441e-bc54-9c6332e7039e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:22.818576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726838e-a289-441e-bc54-9c6332e7039e None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:22.819893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:22.825811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97469bf5-a9d9-4950-a3d2-4d9159ee3c59 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:22.826234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97469bf5-a9d9-4950-a3d2-4d9159ee3c59 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:22.826370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97469bf5-a9d9-4950-a3d2-4d9159ee3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:22.843728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97469bf5-a9d9-4950-a3d2-4d9159ee3c59 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:22.844981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97469bf5-a9d9-4950-a3d2-4d9159ee3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:22.852825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:22.890163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726838e-a289-441e-bc54-9c6332e7039e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:22.900886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726838e-a289-441e-bc54-9c6332e7039e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:22.904612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:22.905289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:22.905579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:22.905862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:22.914905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:22.916343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb36128-040e-4553-9496-f16a47aa0e34 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:22.926736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 736/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:24.977178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c061-532c-4325-82e1-50496fcb3706 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:24.977745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c061-532c-4325-82e1-50496fcb3706 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:24.977745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c061-532c-4325-82e1-50496fcb3706 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:24.979125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:24.985258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054d01-c5cd-4cd7-b211-d25d1927be2d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:24.985663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054d01-c5cd-4cd7-b211-d25d1927be2d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:24.985817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054d01-c5cd-4cd7-b211-d25d1927be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:25.003839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-09054d01-c5cd-4cd7-b211-d25d1927be2d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:25.005061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-09054d01-c5cd-4cd7-b211-d25d1927be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:25.013796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:25.050418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c061-532c-4325-82e1-50496fcb3706 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:25.061044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c061-532c-4325-82e1-50496fcb3706 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:25.064522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:25.065187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:25.065472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:25.065765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:25.075131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:25.076556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fded92-72ee-45d6-9071-356f997983be service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:25.085948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 733/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:34.998786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=17 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:35.081709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=17 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:45.638882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a36-5ce5-4c67-aa3d-0a8b64c16cae None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:45.639510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a36-5ce5-4c67-aa3d-0a8b64c16cae None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:45.639510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a36-5ce5-4c67-aa3d-0a8b64c16cae None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:45.640826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 738/1471] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:45.646180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737905-270e-4c25-8687-53603d381251 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:45.646613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737905-270e-4c25-8687-53603d381251 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:45.646750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737905-270e-4c25-8687-53603d381251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:45.664872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf737905-270e-4c25-8687-53603d381251 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:45.666072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf737905-270e-4c25-8687-53603d381251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:45.674179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 734/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:52:45.762006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237831-4c1e-4618-b180-c8afcb2b9e78 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:45.762300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237831-4c1e-4618-b180-c8afcb2b9e78 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:45.762612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237831-4c1e-4618-b180-c8afcb2b9e78 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:45.763961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 739/1473] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 5 12:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:45.769041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d3f4-844a-4c2c-8f06-b810f880a3e6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:45.769340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d3f4-844a-4c2c-8f06-b810f880a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:45.769657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d3f4-844a-4c2c-8f06-b810f880a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:45.787543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5cc2d3f4-844a-4c2c-8f06-b810f880a3e6 None None] MFA Rules not processed for user `387a99329ad748118d233f4a2c644c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:45.788791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5cc2d3f4-844a-4c2c-8f06-b810f880a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:45.795593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 735/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 5 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:45.802811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237831-4c1e-4618-b180-c8afcb2b9e78 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:45.814063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237831-4c1e-4618-b180-c8afcb2b9e78 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:45.817574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:45.818206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:45.818492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:45.818771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:45.827611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:45.829065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7827-3e9a-4876-bedb-f7635b83b010 service glance] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:45.838777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 740/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:52:47.973039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49960f-20c2-4a01-b1da-c4badc01054c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.973609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49960f-20c2-4a01-b1da-c4badc01054c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.973609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49960f-20c2-4a01-b1da-c4badc01054c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.975004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 736/1476] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:47.980643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c63-2c91-4561-bb51-df3d9c2094e2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.981115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c63-2c91-4561-bb51-df3d9c2094e2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.981231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c63-2c91-4561-bb51-df3d9c2094e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.999428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e6557c63-2c91-4561-bb51-df3d9c2094e2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:48.000620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e6557c63-2c91-4561-bb51-df3d9c2094e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:48.008453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 741/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:52:48.033339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49960f-20c2-4a01-b1da-c4badc01054c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:48.046131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49960f-20c2-4a01-b1da-c4badc01054c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:48.050584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:48.051242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:48.051525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:48.051801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:48.052568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:48.054374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:52:48.054374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:52:48.054374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:52:48.055514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d122da-e83d-43f3-b882-27fa41e3b1a6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:48.076148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 737/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 5 12:52:48 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:52:50.118989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db2d4-77c8-4e6e-b912-c93a9e4ec20e None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:50.120120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db2d4-77c8-4e6e-b912-c93a9e4ec20e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:50.120226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db2d4-77c8-4e6e-b912-c93a9e4ec20e None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:50.121579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 742/1479] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:50.126919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b08f3-b20d-4910-a447-2f7f3959e3d5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:50.127346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b08f3-b20d-4910-a447-2f7f3959e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:50.127532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b08f3-b20d-4910-a447-2f7f3959e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:50.145456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-855b08f3-b20d-4910-a447-2f7f3959e3d5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:50.146680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-855b08f3-b20d-4910-a447-2f7f3959e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:50.154685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 738/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:50.197607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977db2d4-77c8-4e6e-b912-c93a9e4ec20e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:50.211991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977db2d4-77c8-4e6e-b912-c93a9e4ec20e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:50.218144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:50.218788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:50.219077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:50.219421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:50.227535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:50.230027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511fd6-e312-44f8-84bd-7b51b7564ee5 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:50.240260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 743/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:52.482920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33f778-a4fb-40f6-8574-fb13ea79c713 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:52.483446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33f778-a4fb-40f6-8574-fb13ea79c713 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:52.483560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33f778-a4fb-40f6-8574-fb13ea79c713 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:52.484873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 739/1482] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:52.490333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654accbe-bb08-466b-8b04-e26cd7926d57 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:52.490772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654accbe-bb08-466b-8b04-e26cd7926d57 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:52.490911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654accbe-bb08-466b-8b04-e26cd7926d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:52.509026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-654accbe-bb08-466b-8b04-e26cd7926d57 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:52.510810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-654accbe-bb08-466b-8b04-e26cd7926d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:52.520156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 744/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:52.555955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33f778-a4fb-40f6-8574-fb13ea79c713 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:52.567442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33f778-a4fb-40f6-8574-fb13ea79c713 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:52.571011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:52.571653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:52.571941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:52.572950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:52.581961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:52.583395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f40d41-9624-4554-a416-c0e391804d6e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:52.593114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 740/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:54.682197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580615-f832-473d-ab6d-33a3cecfcdbf None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:54.682771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580615-f832-473d-ab6d-33a3cecfcdbf None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:54.682771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580615-f832-473d-ab6d-33a3cecfcdbf None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:54.684090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 745/1485] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:54.689194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bf46-b219-49ee-957e-79e001302661 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:54.689614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bf46-b219-49ee-957e-79e001302661 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:54.689761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bf46-b219-49ee-957e-79e001302661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:54.707821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3141bf46-b219-49ee-957e-79e001302661 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:54.709062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3141bf46-b219-49ee-957e-79e001302661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:54.717506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 741/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:54.755827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580615-f832-473d-ab6d-33a3cecfcdbf None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:54.767091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580615-f832-473d-ab6d-33a3cecfcdbf None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:54.770478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:54.771111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:54.771392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:54.771666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:54.780368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:54.781817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17494-2112-41b8-bd77-458051d96cb1 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:54.791074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 746/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:56.928210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc202-1a11-425a-83e9-cfbc74f8e714 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:56.928725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc202-1a11-425a-83e9-cfbc74f8e714 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:56.928839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc202-1a11-425a-83e9-cfbc74f8e714 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:56.930181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 742/1488] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:56.935578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2f34-34f8-4a0f-ba3a-b4b076800744 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:56.935988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2f34-34f8-4a0f-ba3a-b4b076800744 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:56.936148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2f34-34f8-4a0f-ba3a-b4b076800744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:56.954890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cecf2f34-34f8-4a0f-ba3a-b4b076800744 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:56.956092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cecf2f34-34f8-4a0f-ba3a-b4b076800744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:56.964789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 747/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:57.004934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dc202-1a11-425a-83e9-cfbc74f8e714 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:57.016656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dc202-1a11-425a-83e9-cfbc74f8e714 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:57.020201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:57.020890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:57.021176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:57.021451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:57.030940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:57.032369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c69b0b-39f4-4e89-8372-fd2eb444a79d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:57.042979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 743/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:59.497725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac58f-17b5-48fd-855d-84952ad17442 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:59.498284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac58f-17b5-48fd-855d-84952ad17442 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:59.498284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac58f-17b5-48fd-855d-84952ad17442 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:59.499650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 748/1491] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 5 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:59.505002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f5e4-0f65-4c38-bde2-86fff932f27b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:59.505396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f5e4-0f65-4c38-bde2-86fff932f27b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:59.505607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f5e4-0f65-4c38-bde2-86fff932f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:59.523156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a519f5e4-0f65-4c38-bde2-86fff932f27b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:59.524347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a519f5e4-0f65-4c38-bde2-86fff932f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:59.532646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 744/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:59.571083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac58f-17b5-48fd-855d-84952ad17442 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:59.582316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac58f-17b5-48fd-855d-84952ad17442 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:59.585841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:59.586478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:59.586762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:59.587039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:59.598347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:59.599772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5708d6-b9b9-4614-b7d7-99cd9bd01e47 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:59.609140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 749/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:53:09.518097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=33 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:09.605001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=33 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:39.787017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.787629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.787967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.807634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:39.809023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:39.817265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 745/1494] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:39.826408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.826945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.826945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.845603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:39.847115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:39.856158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 750/1495] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:39.860804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:39.871456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753c163-6e44-4ff1-ad97-6ce52c1f247b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:39.877733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:39.878446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.878714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.878991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.879722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:54:39.880034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:39.881125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:39.881125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:54:39.881125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:54:39.882026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:39.893529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 746/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:54:39.901679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:39.912690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6cc83-1647-4e17-bd93-9cfbdd38e95a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:39.917545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:39.918195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.918480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.918755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.919458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:39.921278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:39.921278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:54:39.921278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:54:39.922549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.042415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 751/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:54:39 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:54:40.046637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.057190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5d92-f832-4442-8822-c5f17842be3f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.112781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.113451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.113742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.114024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.114887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.116177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:40.116177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:54:40.116177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:54:40.117418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.190525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 747/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:54:40 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:54:40.194617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.204938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564d75-399b-4c71-acbc-437c01e40af3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.210034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.210697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.210984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.211264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.211999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.213047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:40.213047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:54:40.213047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:54:40.213933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.227036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 752/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:54:40.230847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.241229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc46c2-2e3b-40fc-af82-784a2e1e8cc7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.245763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.246416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.246698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.246972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.247700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.248721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:40.248721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:54:40.248721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:54:40.249596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654d4a2-dbf7-444a-a3fb-ea1c4c0a1923 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.263012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 748/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:54:40.267224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.278449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e822b-32f1-472f-8ce5-fd48d166bfd9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.283159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.284046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.286368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.286368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] PATH_INFO: `/v3/projects/72a1a3c136ec43f18e3a9980f3ece6df/users/ae1eda0008c0474bb7f72c0772cfc356/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.300457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a1a3c136ec43f18e3a9980f3ece6df, user_id=ae1eda0008c0474bb7f72c0772cfc356, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.301479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:40.301479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:54:40.301479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:54:40.303526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d22f0-fb5f-4714-865b-d463a460bec9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.355542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 753/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:54:40 2022] PUT /identity/v3/projects/72a1a3c136ec43f18e3a9980f3ece6df/users/ae1eda0008c0474bb7f72c0772cfc356/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:54:40.368220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f49fbe-fca8-4b1c-89d6-6d8463b7c69c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.368514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f49fbe-fca8-4b1c-89d6-6d8463b7c69c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.368832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f49fbe-fca8-4b1c-89d6-6d8463b7c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.395680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-20f49fbe-fca8-4b1c-89d6-6d8463b7c69c None None] MFA Rules not processed for user `ae1eda0008c0474bb7f72c0772cfc356`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:40.397715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-20f49fbe-fca8-4b1c-89d6-6d8463b7c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:40.460241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 749/1502] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:40.473415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d186-c7d8-4234-8f8a-1096d411c5a0 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.473728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d186-c7d8-4234-8f8a-1096d411c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.474042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d186-c7d8-4234-8f8a-1096d411c5a0 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.475417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 754/1503] 10.222.0.25 () {54 vars in 963 bytes} [Tue Jul 5 12:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:40.480020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa54a-6975-4940-badb-ff2691f73f2d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.480318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa54a-6975-4940-badb-ff2691f73f2d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.480600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa54a-6975-4940-badb-ff2691f73f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.498585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-961aa54a-6975-4940-badb-ff2691f73f2d None None] MFA Rules not processed for user `4c4dafecd5b64ac6bbc26ac0a236ebfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:40.499794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-961aa54a-6975-4940-badb-ff2691f73f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:40.542590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:40.549771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 750/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Jul 5 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:40.557662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d186-c7d8-4234-8f8a-1096d411c5a0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.568949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d186-c7d8-4234-8f8a-1096d411c5a0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.572597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.573145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.573432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.573713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.582310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.583949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.592647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 755/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:54:40.635221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ce8bb-2c27-498a-8d50-4842d8d69625 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.635541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ce8bb-2c27-498a-8d50-4842d8d69625 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.635818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ce8bb-2c27-498a-8d50-4842d8d69625 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.637166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 751/1506] 10.222.0.25 () {52 vars in 829 bytes} [Tue Jul 5 12:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:40.640638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.702188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb13d2-e024-4a75-a664-83dfde4f1710 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.706708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.707590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.707876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.708160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] PATH_INFO: `/v3/users/ae1eda0008c0474bb7f72c0772cfc356` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.709911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1eda0008c0474bb7f72c0772cfc356)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.710918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:40.710918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:54:40.710918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:54:40.712131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.913032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1eda0008c0474bb7f72c0772cfc356'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:40.925135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1eda0008c0474bb7f72c0772cfc356'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:40.925836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1eda0008c0474bb7f72c0772cfc356'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:40.926561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1eda0008c0474bb7f72c0772cfc356'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.025229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1eda0008c0474bb7f72c0772cfc356'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.042914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:41.050618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 756/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:54:40 2022] DELETE /identity/v3/users/ae1eda0008c0474bb7f72c0772cfc356 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:54:41.055069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.055588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.055686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.073428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:41.074638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:41.136532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 752/1508] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:41.147760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:41.149229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:41.205836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537071f3-c83b-4b25-bddd-80f0b4cf1bc2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:41.210023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:41.210677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.210965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.211251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.220089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:41.221567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03f876-8d0f-4cff-a617-17260fd89729 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:41.231000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 757/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:41.670734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:41.672413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:41.685100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d34a9-f951-43bd-820f-0da55bbc4a88 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:41.690742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:41.691641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.691925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.692250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] PATH_INFO: `/v3/projects/72a1a3c136ec43f18e3a9980f3ece6df` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.697039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a1a3c136ec43f18e3a9980f3ece6df)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:41.697039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:54:41.697039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:54:41.697039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:54:41.697039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:41.858561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a1a3c136ec43f18e3a9980f3ece6df', 'request_id': 'req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.947935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a1a3c136ec43f18e3a9980f3ece6df', 'request_id': 'req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.962559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a1a3c136ec43f18e3a9980f3ece6df', 'request_id': 'req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.973684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] The token cache is being invalidate because project 72a1a3c136ec43f18e3a9980f3ece6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:54:41.974088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.974755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97c5a89-6fba-48b6-8517-9417c8a3d9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:54:41.976433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 753/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:54:41 2022] DELETE /identity/v3/projects/72a1a3c136ec43f18e3a9980f3ece6df => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:54:51.226901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:51.970454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:56:25.980102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:25.980735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:25.980735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:25.982043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:56:25.987049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dd5-e2da-4d4f-85fb-82658f647703 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:25.987496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dd5-e2da-4d4f-85fb-82658f647703 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:25.987606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dd5-e2da-4d4f-85fb-82658f647703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:26.006089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f4b40dd5-e2da-4d4f-85fb-82658f647703 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:26.007328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f4b40dd5-e2da-4d4f-85fb-82658f647703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:26.065787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:56:26.217563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:26.219253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:26.292396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366433a2-e7b5-4d2b-b41a-ec634248e284 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:26.298176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:26.298949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:26.299230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:26.299501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:26.307488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:26.309101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0081f-ef1e-4532-953c-ab2797bcbb36 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:26.318479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 759/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:27.142571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93e98-d639-4699-ac72-36e7118a42df None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:27.143123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93e98-d639-4699-ac72-36e7118a42df None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:27.143123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93e98-d639-4699-ac72-36e7118a42df None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:27.144487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:27.149240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1fcb-b2bd-4c26-bca7-294d0b172253 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:27.149688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1fcb-b2bd-4c26-bca7-294d0b172253 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:27.149795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1fcb-b2bd-4c26-bca7-294d0b172253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:27.167960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0ebc1fcb-b2bd-4c26-bca7-294d0b172253 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:27.169189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0ebc1fcb-b2bd-4c26-bca7-294d0b172253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:27.177579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:27.331476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93e98-d639-4699-ac72-36e7118a42df None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:27.346390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93e98-d639-4699-ac72-36e7118a42df None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:27.351762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:27.352403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:27.352715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:27.353003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:27.361187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:27.362794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2684a2-1bf8-4797-9d05-ad98587d0ac7 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:27.372352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 756/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:27.946060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fc62d-df80-4fcd-9bf7-fb846c9b2c59 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:27.946354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fc62d-df80-4fcd-9bf7-fb846c9b2c59 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:27.946639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fc62d-df80-4fcd-9bf7-fb846c9b2c59 None None] PATH_INFO: `/v3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:27.947943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 761/1517] 10.222.0.26 () {54 vars in 925 bytes} [Tue Jul 5 12:56:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:56:27.954715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69d80-cb76-4806-9ea5-0c93b2461979 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:27.955008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69d80-cb76-4806-9ea5-0c93b2461979 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:27.955292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69d80-cb76-4806-9ea5-0c93b2461979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:27.973310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b2c69d80-cb76-4806-9ea5-0c93b2461979 None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:27.974527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b2c69d80-cb76-4806-9ea5-0c93b2461979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:28.037479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 757/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 5 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:37.162856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=37 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:56:37.197192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdaf34-65ad-4ddf-ae65-316dc542d9ff None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:37.197483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdaf34-65ad-4ddf-ae65-316dc542d9ff None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:37.197765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdaf34-65ad-4ddf-ae65-316dc542d9ff None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:37.199115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 762/1519] 10.222.0.25 () {54 vars in 960 bytes} [Tue Jul 5 12:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:37.204585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a5a9-e1aa-4b9e-a760-45fcdc7e5f82 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:37.205031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a5a9-e1aa-4b9e-a760-45fcdc7e5f82 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:37.205205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a5a9-e1aa-4b9e-a760-45fcdc7e5f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:37.222921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5ce5a5a9-e1aa-4b9e-a760-45fcdc7e5f82 None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:37.224118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5ce5a5a9-e1aa-4b9e-a760-45fcdc7e5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:37.232582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 758/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Tue Jul 5 12:56:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:37.241033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdaf34-65ad-4ddf-ae65-316dc542d9ff None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:37.255310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdaf34-65ad-4ddf-ae65-316dc542d9ff None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:37.260118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:37.260790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:37.261083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:37.261360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:37.269666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:37.271243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b688f-5466-44a9-85ee-c22eec211cec service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:37.280630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 763/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:38.616000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f78d-02b1-43db-b8b7-cff0746b894c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:38.616842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f78d-02b1-43db-b8b7-cff0746b894c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:38.616945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f78d-02b1-43db-b8b7-cff0746b894c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:38.618296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:38.623284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816671b-5f29-4503-b52e-892875fac6e8 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:38.623713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816671b-5f29-4503-b52e-892875fac6e8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:38.623846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816671b-5f29-4503-b52e-892875fac6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:38.642103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d816671b-5f29-4503-b52e-892875fac6e8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:38.643300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d816671b-5f29-4503-b52e-892875fac6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:38.651242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:38.804797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53f78d-02b1-43db-b8b7-cff0746b894c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:38.819837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53f78d-02b1-43db-b8b7-cff0746b894c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:38.825277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:38.825941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:38.826219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:38.826494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:38.835315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:38.836936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83a678-9b6c-4695-8e14-7a052fb154a5 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:38.846592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 760/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:39.681873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a85e-9649-412b-a59a-5c3dd1a9ebc4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:39.682457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a85e-9649-412b-a59a-5c3dd1a9ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:39.682561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638a85e-9649-412b-a59a-5c3dd1a9ebc4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:39.683858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:39.689105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef3c-a8ac-4dab-96db-0a9e51d7f36c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:39.689519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef3c-a8ac-4dab-96db-0a9e51d7f36c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:39.689658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ef3c-a8ac-4dab-96db-0a9e51d7f36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:39.707841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7252ef3c-a8ac-4dab-96db-0a9e51d7f36c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:39.709057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7252ef3c-a8ac-4dab-96db-0a9e51d7f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:39.716761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:39.868878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638a85e-9649-412b-a59a-5c3dd1a9ebc4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:39.883659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638a85e-9649-412b-a59a-5c3dd1a9ebc4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:39.889149 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:39.889790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:39.890074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:39.890350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:39.899248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:39.900859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de57f6-9a43-4658-a10c-82db80d5fc76 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:39.910164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 766/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:43.838874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:43.839438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:43.839438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:43.840849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:43.847017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65b537-8647-4762-986b-4eaa9de0bc01 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:43.847449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65b537-8647-4762-986b-4eaa9de0bc01 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:43.847582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65b537-8647-4762-986b-4eaa9de0bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:43.865360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6a65b537-8647-4762-986b-4eaa9de0bc01 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:43.866828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6a65b537-8647-4762-986b-4eaa9de0bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:43.874768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:43.946313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:43.948013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:44.006153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c121c6-7f65-4447-a86b-697eb9abee6a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:44.009733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:44.010383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:44.010665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:44.010940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:44.020904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:44.022342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bb27c-088a-4461-98c2-84372aae9804 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:44.027221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:56:44.032948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 763/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:46.037498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c288-924d-4739-9c97-e0d9e09a6e77 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:46.037940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c288-924d-4739-9c97-e0d9e09a6e77 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:46.038056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c288-924d-4739-9c97-e0d9e09a6e77 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:46.039406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:46.044491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc06f-d2a8-49ef-90ed-515a6bb5182f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:46.044960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc06f-d2a8-49ef-90ed-515a6bb5182f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:46.045109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc06f-d2a8-49ef-90ed-515a6bb5182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:46.063412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-495dc06f-d2a8-49ef-90ed-515a6bb5182f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:46.064650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-495dc06f-d2a8-49ef-90ed-515a6bb5182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:46.072542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:56:46.109110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c288-924d-4739-9c97-e0d9e09a6e77 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:46.120273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c288-924d-4739-9c97-e0d9e09a6e77 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:46.123861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:46.124504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:46.124832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:46.125254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:46.134220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:46.135641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714ac30-66bf-438e-a366-dd06bbc7e25e service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:46.145432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 769/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:49.681889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:49.682451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:49.682451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:49.683809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:49.689497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fac0b-f404-4383-8044-d4bd7f4eb41b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:49.689905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fac0b-f404-4383-8044-d4bd7f4eb41b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:49.690065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fac0b-f404-4383-8044-d4bd7f4eb41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:49.707741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d92fac0b-f404-4383-8044-d4bd7f4eb41b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:49.708964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d92fac0b-f404-4383-8044-d4bd7f4eb41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:49.716716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:56:50.018605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:50.020354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:50.079707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bae7ca-7293-4c5b-924d-e2beff1ac087 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:50.083270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:50.083919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:50.084205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:50.084484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:50.093238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:50.095325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a82182-9c5a-4574-8028-f1fab9281391 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:50.104493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 766/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:56:52.154025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942661-0280-4464-840d-f8706226d027 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:52.154584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942661-0280-4464-840d-f8706226d027 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:52.154584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942661-0280-4464-840d-f8706226d027 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:52.155988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:56:52.162032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f00e6-498d-43ea-9761-845decfd34f8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:52.162447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f00e6-498d-43ea-9761-845decfd34f8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:52.162583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f00e6-498d-43ea-9761-845decfd34f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:52.179982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c66f00e6-498d-43ea-9761-845decfd34f8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:56:52.181298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c66f00e6-498d-43ea-9761-845decfd34f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:52.189524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:56:52.493004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca942661-0280-4464-840d-f8706226d027 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:56:52.494705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ca942661-0280-4464-840d-f8706226d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:56:52.507767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca942661-0280-4464-840d-f8706226d027 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:56:52.511515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:56:52.512165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:56:52.515101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:56:52.515101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:56:52.521934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:56:52.523359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fba5d-0b7e-43da-a8f3-f1d8431c0c9b service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:56:52.533245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 772/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:57:02.175172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=32 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:57:02.528532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=33 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:32.330483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.331662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.332181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.355480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.357798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.371756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 768/1540] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.382198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.383264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.384267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.409768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.411372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.426465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 773/1541] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.430951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:32.446378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f72c-5b13-4db3-8e40-3c16aa876fa7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:32.451660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:32.452615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.453148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.453664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.454618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:32.455147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:32.457040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed8be2-d22e-4ffd-af3f-73d55cce3a82 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:32.474853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 769/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:32.483743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:32.493916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2a2fb-d02e-4c55-813c-a1d46c087d8a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:32.509372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:32.510431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.510946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.511464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.512385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:32.514725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:32.534682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7c00-8403-4d16-abf2-cd713d5b4ae1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.535354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7c00-8403-4d16-abf2-cd713d5b4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.535866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7c00-8403-4d16-abf2-cd713d5b4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.561786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0edc7c00-8403-4d16-abf2-cd713d5b4ae1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.566305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0edc7c00-8403-4d16-abf2-cd713d5b4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.575005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 770/1543] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.584920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.585212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.585526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.609891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.611129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.623417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 771/1544] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:32.628636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:32.648850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 774/1545] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:32.650623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ff498-3b3e-4964-8420-eb326f431b2d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:32.654529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:32.768480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:32.769278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.769498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.769766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.770508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:32.770816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:32.772782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e507a-311b-4261-8e0d-0512d3637cb2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:32.780288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9242-618c-4425-8e10-cfdb28b96e57 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:32.788883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 772/1546] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:32.790315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967e02-a3cc-4fef-aa6a-31c4915a1c51 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.790610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967e02-a3cc-4fef-aa6a-31c4915a1c51 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.790890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967e02-a3cc-4fef-aa6a-31c4915a1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.802792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:32.803503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.803793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.804076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.804848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:32.805878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:32.805878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:58:32.805878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:58:32.807118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734e07f-7d5d-407a-90d8-4074f640bca5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:32.814831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-91967e02-a3cc-4fef-aa6a-31c4915a1c51 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.816040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-91967e02-a3cc-4fef-aa6a-31c4915a1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.828070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 773/1547] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.829815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.830104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.830379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.851631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.852774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.862355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 774/1548] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.863160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:32.873697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3b489-c24f-4c84-bd04-b65cf2f001f9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:32.878784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:32.879488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.879817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.880093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.880809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:32.881819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:32.881819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:58:32.881819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:58:32.882994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7260d11-03c4-4b1a-8ea2-05944ecd9c17 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:32.895252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 775/1549] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:58:32.898167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dfcf-07c3-4e76-973a-ecf20f12bb78 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.898167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dfcf-07c3-4e76-973a-ecf20f12bb78 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.898167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dfcf-07c3-4e76-973a-ecf20f12bb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.917988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1f95dfcf-07c3-4e76-973a-ecf20f12bb78 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.919219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1f95dfcf-07c3-4e76-973a-ecf20f12bb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.928247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 776/1550] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.929914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acedc9-04f4-49ce-89b1-f00159f2f448 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.930269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acedc9-04f4-49ce-89b1-f00159f2f448 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.930640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acedc9-04f4-49ce-89b1-f00159f2f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.949079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-37acedc9-04f4-49ce-89b1-f00159f2f448 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.951219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-37acedc9-04f4-49ce-89b1-f00159f2f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.959219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 777/1551] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:32.960417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd694-cafb-499d-a2c3-3a3b645540b2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.960752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd694-cafb-499d-a2c3-3a3b645540b2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.961032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd694-cafb-499d-a2c3-3a3b645540b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.972402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 775/1552] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:32.977813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ba9b-b5a8-4602-92c8-b4eaece4f5ea None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:32.977813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ba9b-b5a8-4602-92c8-b4eaece4f5ea None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:32.977813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ba9b-b5a8-4602-92c8-b4eaece4f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:32.979425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-69edd694-cafb-499d-a2c3-3a3b645540b2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.980608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-69edd694-cafb-499d-a2c3-3a3b645540b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:32.993252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d256ba9b-b5a8-4602-92c8-b4eaece4f5ea None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:32.994332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d256ba9b-b5a8-4602-92c8-b4eaece4f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.045492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 778/1553] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.047154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.047687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.047968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.061163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 776/1554] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.062415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0f8a-1942-485a-b6db-25a7bbdd2707 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.062807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0f8a-1942-485a-b6db-25a7bbdd2707 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.063186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0f8a-1942-485a-b6db-25a7bbdd2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.065775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.066973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.076436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 779/1555] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.077657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.086937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1747c-2828-4f30-88f3-6c398a5b95a7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.087143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-aa5f0f8a-1942-485a-b6db-25a7bbdd2707 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.088401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aa5f0f8a-1942-485a-b6db-25a7bbdd2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.092258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.093098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.093383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.093760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.094511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.096105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46417fa1-9b18-443f-9588-9d3d3974cc5f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.097863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 777/1556] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.099293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.099587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.099866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.107337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 780/1557] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:33.108928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.109225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.109508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.121402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.123277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.127949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.129122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.131620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 778/1558] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.135336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.139866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 781/1559] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.141592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.141809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429864b5-3f63-41ca-ab3e-b957765e98da None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.146383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.147031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.147314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.147593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.148270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.150229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.151392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2384e0-dd17-4010-a4f0-5eb3334c3da6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.156163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.156837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.157294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.157579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.158777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.159088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.160092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:33.160092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:58:33.160092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:58:33.160770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:33.166859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826051aa-42d8-40e7-b6ea-c7cf38ee6dd8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.173129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 782/1560] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.174337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0ce9-fb94-471f-85ec-de37100e61bf None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.174628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0ce9-fb94-471f-85ec-de37100e61bf None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.174906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0ce9-fb94-471f-85ec-de37100e61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.192457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f94e0ce9-fb94-471f-85ec-de37100e61bf None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.193692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f94e0ce9-fb94-471f-85ec-de37100e61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.201529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 783/1561] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.202704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.202996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.203276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.209916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:33.221289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:33.224267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:33.230251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 784/1562] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:33.231003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.240477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe43a53-9939-4199-8c00-d4b3138b5969 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.245296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.245928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.246211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.246489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.247210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.247604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.249256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.257099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 779/1563] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.257099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.260449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3a2c-7e56-4c99-8481-a85cdfacc283 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.261912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 785/1564] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.262593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.272171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8b8-603d-44c5-9ad6-e1ee17ae3f44 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.279231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.279231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.279231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.279231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.279623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.279623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.279828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.279828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.279828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.279828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.280174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.280174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.281422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.288783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 780/1565] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:33.292044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.293338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 786/1566] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.294061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.306224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e96f8-9c74-4ad9-a788-bf740e0eecc7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.306779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5529be-1777-4461-8c7a-82984d769c98 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.311208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.311872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.312063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.312174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.312416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.312999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.313202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.313430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.313532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.313839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.314609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.315092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.316718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.327630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 781/1567] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.328282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.339804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7c61-61b8-4c1b-8648-e4fa0d23d462 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.345460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.346103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.346386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.347525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.348693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.352979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.352979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.363407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 782/1568] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.364229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.374364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f281-3a2f-450f-9f9f-5bf3dc3d2e0e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.379042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.379680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.379995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.380271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.381059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:33.381365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.382968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.396047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 783/1569] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:33.396880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.408504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 787/1570] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.408504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.409181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd9d7c-9b4c-43db-b78d-1690c8be26c6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.463064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.463743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.464026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.464299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.465062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.467225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.469037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f8695-e4cf-4a5f-9070-af67a8218fdd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.473766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.482734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.482734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.482734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.482734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.482734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.483248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 784/1571] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:33.483248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.490436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7b8fa-b45a-409f-a65c-91c306853087 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.495395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.496272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.496554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.496869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] PATH_INFO: `/v3/projects/1eecb630e16b46b7970cb58916ead32c/users/b75999cf46b744d2b5623c5615db2401/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.511888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eecb630e16b46b7970cb58916ead32c, user_id=b75999cf46b744d2b5623c5615db2401, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.512993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:33.512993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:58:33.512993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:58:33.514918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.567881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 788/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.567881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.585982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 785/1573] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:33 2022] PUT /identity/v3/projects/1eecb630e16b46b7970cb58916ead32c/users/b75999cf46b744d2b5623c5615db2401/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:33.593587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.632458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592acb0-b6ee-40a4-b097-0032e2620e87 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.649373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be9949-53da-4267-8c37-59d5c1193137 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.654763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.655441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.655721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.656084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.656838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.660013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.674436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:33.690794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.691469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.691754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.692029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.692767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.694759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.735664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 786/1574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.736473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.740529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:33.772900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 789/1575] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.772900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.796719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aa1ed-fff6-4716-9299-8745230ddd3a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.833153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bad496-0519-45e3-ba5d-d1cd9bcb2842 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:33.837890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.838568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.838858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.839139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.839835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.841814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.852339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:33.853052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:33.853309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:33.853603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:33.854261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:33.856168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:33.929886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 790/1576] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.930637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.942590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 787/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:33.943727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:33.995325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ea6-e64d-471c-9bf5-26f699e2e088 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.007762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be3b33-70c0-4b66-963f-1f13dee551ad admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.012473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.013442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.013726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.014112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.014859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.016492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.027090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 788/1578] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.028104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.038727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151677c-9530-4659-a2b5-17d554938448 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.043324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.043973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.045140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.045937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.046176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.048016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cbdf9-167f-4b53-bc48-41b549663789 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.055004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.055679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.055966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.056246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.056973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.058904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.065782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:34.145560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 789/1579] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.146901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.147187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.147460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.158918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 791/1580] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:33 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.159897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.168600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:34.169315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0009-31eb-4ab1-8f3f-e1b39ddae7f4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.170420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:34.175173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.175831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.176115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.176394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.177116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.181494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 790/1581] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:34.181641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.181752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.189382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a56ed-d17e-42bb-8981-5ccca39015f8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.194354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.195061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.195378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.195659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.196351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.198361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.205006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:34.279463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 792/1582] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.279463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.287183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775080-9232-4b89-9c75-8cbf24943bea admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.288660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 791/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.289546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.292178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.292867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.293153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.293428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.294117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.296976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.299905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ae56-e2e6-4717-a2e7-19019f4b7d24 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.304741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.305513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.305806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.306085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.306901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.308838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.405466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 792/1584] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.406126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 793/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:34.406126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.406319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.416237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2fe21-5d3b-4339-8e64-2ea1adafed19 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.420383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a91ea-b6bb-4e22-8401-008019694783 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.421198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.422099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.422388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.422669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] PATH_INFO: `/v3/projects/1f1a6a82b6794f70b60c7e32d618e2ad/users/a426eed4598345878445c6ba2ab913d2/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.425197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.425869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.426161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.426445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.427184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.428877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.437544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1a6a82b6794f70b60c7e32d618e2ad, user_id=a426eed4598345878445c6ba2ab913d2, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.439659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 794/1586] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.440479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.443303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.450081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfa54-cffd-4dc5-8b48-fc789519ee0a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.455364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.459992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.459992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.459992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.459992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.459992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.469328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 795/1587] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.470257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.522129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfca40-7c19-406a-b9e3-4e34d28772eb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.529443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 793/1588] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:34 2022] PUT /identity/v3/projects/1f1a6a82b6794f70b60c7e32d618e2ad/users/a426eed4598345878445c6ba2ab913d2/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:34.533825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.573681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.574341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.574629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.574938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.595184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923a69-76a0-4a7c-8403-ff276cbc996f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.599829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.600621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.601028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.601316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.602058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.603681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.613795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 794/1589] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.614685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.624567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810b3e-5240-41fc-bd4d-874fbe48951c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.629512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.630161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.630472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.630751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.631476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.633142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.635612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.637110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.641662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:34.643557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 795/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.644353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.647824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 796/1591] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:34.648628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.656026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fad86b-015a-4f5a-80b1-697fc87c6d13 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.658408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c2e4-3753-40cf-bcf5-98622f6fd4d6 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.660736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.661412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.661697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.662313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.662707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.663826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.664392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.664522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.664837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.665118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.665879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.667477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.678830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 796/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.678830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.682073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 797/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.682073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.688020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb396801-13a9-48d4-9e60-7848e05e2c8f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.689904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24770a-a9e1-417c-bf3e-2a2bb68e8feb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.692658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.693410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.693701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.693981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.694438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.694709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.695147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.695436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.695715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.696308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02534-08fa-4fce-a577-48009891ed13 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.696448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.698141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.707566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 797/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.709096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.709389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.709670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.713178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 798/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.713178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.720723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595869-27b2-4829-80ea-3b14499f8940 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.725755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.726409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.726690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.726965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.727734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.728816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:34.729377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.730036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:34.739242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 798/1596] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:34.739242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.743219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 799/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.743219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.751842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f8b-424c-4116-8026-54eb3dca02d3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.753258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc329bb2-5480-4f91-8573-ee515775826f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.756753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.757414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.757697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.757970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.758096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.758633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.758751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.758995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.759278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.760017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.760311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.761647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.770796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 800/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.774570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 799/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.781617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.781886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.786557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecd1fc-c2af-4a5c-8dde-1cd2f6e1c4f9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.787643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06218db-456d-4a95-ad1f-9d5362ab19ef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.791530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.792196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.792481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.792783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.793131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.793568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.794118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.794295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.795069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] PATH_INFO: `/v3/projects/5ec2898bd89643eb8ad3f2a9bb1aac40/users/faa03e9023bb4b7a84cee7fa85bcf1aa/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.795255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.805647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 801/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:34.810704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.815910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec2898bd89643eb8ad3f2a9bb1aac40, user_id=faa03e9023bb4b7a84cee7fa85bcf1aa, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.818407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de64d-2435-4696-bd55-66d8614f18aa admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:34.819048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.823143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:34.824034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:34.824312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:34.824613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] PATH_INFO: `/v3/projects/d43a6a28acd74773a12db34c55fae672/users/a31db81d1da841d28fb371846b468e30/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:34.840749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43a6a28acd74773a12db34c55fae672, user_id=a31db81d1da841d28fb371846b468e30, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:34.843511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:34.911879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 800/1601] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:34 2022] PUT /identity/v3/projects/5ec2898bd89643eb8ad3f2a9bb1aac40/users/faa03e9023bb4b7a84cee7fa85bcf1aa/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:34.912718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.943665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:34.948223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 802/1602] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:34 2022] PUT /identity/v3/projects/d43a6a28acd74773a12db34c55fae672/users/a31db81d1da841d28fb371846b468e30/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:34.948982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:34.989775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878348e-58de-48b4-be43-b05227c6eedd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.040634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3a1a-2777-4b72-880e-857c3d925dca admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.045201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.045868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.046225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.046430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.065622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.066532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.066817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.067093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] PATH_INFO: `/v3/projects/8f439f3777164bf28f3b80489f7224ef/users/fd274df17fe8496aa3ef04b912a14005/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.082141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f439f3777164bf28f3b80489f7224ef, user_id=fd274df17fe8496aa3ef04b912a14005, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.084926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.111039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.112476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.122142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 803/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:35.123523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.132611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7217-de14-497f-bbae-89e35fcdd67e service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.137293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.138226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.143746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.143746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] PATH_INFO: `/v3/projects/5690b04a1d1e46a487f5f7519ca03f3d/users/0bd8659f2f634e18836fc1203fde25c5/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.154975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5690b04a1d1e46a487f5f7519ca03f3d, user_id=0bd8659f2f634e18836fc1203fde25c5, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.157912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.169794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 801/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:34 2022] PUT /identity/v3/projects/8f439f3777164bf28f3b80489f7224ef/users/fd274df17fe8496aa3ef04b912a14005/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:35.172297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.255058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8f1-d596-4a3c-a20c-4393a5ca2791 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.258106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 804/1605] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:35 2022] PUT /identity/v3/projects/5690b04a1d1e46a487f5f7519ca03f3d/users/0bd8659f2f634e18836fc1203fde25c5/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:35.259011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.267367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:35.337584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235635a3-4aaf-4fa5-978e-be1392c87c5f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.339789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.340975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.345620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.345620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] PATH_INFO: `/v3/projects/021e7f6d6c8c4ddd8851a1890b0d2bc7/users/ea86039e70904324ada4fd2cd9be754e/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.345845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.345845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.345845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.345845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] PATH_INFO: `/v3/projects/bb058227f48841188cd7738b3da8fb4f/users/565b60f6e81348c1b9c98ba1f4fedd08/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.354278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:35.359611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021e7f6d6c8c4ddd8851a1890b0d2bc7, user_id=ea86039e70904324ada4fd2cd9be754e, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.362440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc52486-6bee-46f7-9764-f2cf13ea9ab5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.366085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb058227f48841188cd7738b3da8fb4f, user_id=565b60f6e81348c1b9c98ba1f4fedd08, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.369378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5977c-b03b-4a2a-a583-2e07b13dc7c4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.440861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 802/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:35 2022] PUT /identity/v3/projects/021e7f6d6c8c4ddd8851a1890b0d2bc7/users/ea86039e70904324ada4fd2cd9be754e/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:35.443232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba304-0abf-4e8c-b9ae-de7cc5162690 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.443632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba304-0abf-4e8c-b9ae-de7cc5162690 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.444014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba304-0abf-4e8c-b9ae-de7cc5162690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.462792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ffdba304-0abf-4e8c-b9ae-de7cc5162690 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.464420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ffdba304-0abf-4e8c-b9ae-de7cc5162690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.483996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 805/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:35 2022] PUT /identity/v3/projects/bb058227f48841188cd7738b3da8fb4f/users/565b60f6e81348c1b9c98ba1f4fedd08/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:35.487405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d6c0-c8e0-4742-800b-d4eb58d1aa8a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.487889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d6c0-c8e0-4742-800b-d4eb58d1aa8a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.488174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d6c0-c8e0-4742-800b-d4eb58d1aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.521210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-7279d6c0-c8e0-4742-800b-d4eb58d1aa8a None None] MFA Rules not processed for user `a31db81d1da841d28fb371846b468e30`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.523611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7279d6c0-c8e0-4742-800b-d4eb58d1aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.539302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 803/1608] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.540632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40600-10d5-490f-9768-8f5fca818ca7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.541062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40600-10d5-490f-9768-8f5fca818ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.541447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40600-10d5-490f-9768-8f5fca818ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.571520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bfe40600-10d5-490f-9768-8f5fca818ca7 None None] MFA Rules not processed for user `fd274df17fe8496aa3ef04b912a14005`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.572763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bfe40600-10d5-490f-9768-8f5fca818ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.594418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 806/1609] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.595834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.596130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.596416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.627813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] MFA Rules not processed for user `0bd8659f2f634e18836fc1203fde25c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.629226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.652188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 804/1610] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.654273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e7d2-08ec-4828-8731-60abba58417a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.654621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e7d2-08ec-4828-8731-60abba58417a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.654958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e7d2-08ec-4828-8731-60abba58417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.680287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0b71e7d2-08ec-4828-8731-60abba58417a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.681570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0b71e7d2-08ec-4828-8731-60abba58417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.693174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 805/1611] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.694194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a294b-f531-40ce-9842-4bb48c536523 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.694535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a294b-f531-40ce-9842-4bb48c536523 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.694826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a294b-f531-40ce-9842-4bb48c536523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.736102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 807/1612] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.736102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.736102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.741378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a72a294b-f531-40ce-9842-4bb48c536523 None None] MFA Rules not processed for user `565b60f6e81348c1b9c98ba1f4fedd08`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:35.742884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a72a294b-f531-40ce-9842-4bb48c536523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:35.747909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:35.809666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639af6c-2db7-47bf-b125-b7d1d97e6700 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.813979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.814656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.814960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.815211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.836795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.838807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 806/1613] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:35.839300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.840268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d16b-9f3b-41aa-ba8c-907584bc0c96 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.840511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d16b-9f3b-41aa-ba8c-907584bc0c96 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.840856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d16b-9f3b-41aa-ba8c-907584bc0c96 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.843502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 807/1614] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 5 12:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:35.844234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d16b-9f3b-41aa-ba8c-907584bc0c96 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.852361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:35.855715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 808/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:35.856564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.859519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d16b-9f3b-41aa-ba8c-907584bc0c96 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.864787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.865532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.865911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.866260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.866563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7116c-8c82-41f8-ba19-dfce7ee3cfb8 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.867333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.869361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.871877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.873935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.874298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.874671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.887104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:35.889418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:35.899449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 809/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:35.900256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:35.973528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2198-b1e5-42c5-aafa-c7d33674a431 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:35.975162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:35.975849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:35.976126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:35.976714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:35.991735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.000727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 808/1617] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:36.000727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.001042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49f244-5eca-48cf-8c42-04fda543d6fe service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.019176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 810/1618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:36.020544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.023033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.023033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.088532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142b09-f752-45ef-8dac-5c2c40e6ffa3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.092107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:36.094256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:36.098118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.099715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.100643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.101075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.101903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.104791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.208513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 811/1619] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 5 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:36.210411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.224570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd550181-e7f9-409e-b083-b39b587c79f3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.230343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.231107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.231459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.231856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.232624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.234940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.242609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 809/1620] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:35 2022] POST /identity/v3/projects => generated 363 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:36.243554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.326317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 812/1621] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:36 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:36.326317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.345019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3030c-7b41-44a3-9d76-a01ab5182a22 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.367619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:36.454020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.455339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.455820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.456584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042279bb-29c4-4a8c-a7cd-53ffce9550ec admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.457492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.458957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.461635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.467749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.470667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.470667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.470667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.562806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.564452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.576582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 810/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:36.577641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.584017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:36.588350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5862-cedf-4fa8-8d56-0cd377fcaf02 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.595602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.596775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.596775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.597401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.598827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.600934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.611650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 813/1623] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:36 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:36.617781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 811/1624] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:36.619882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.622083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.642326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e5d7-cb10-4407-b4be-15120b991d3a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.648709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6d5c-3060-439d-8447-a18a45715c7f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.648872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.650058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.650542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.651002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.652107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.654099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.664624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.665635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.665988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.666351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.667268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.669730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.680020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 812/1625] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:36.681737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.702377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba413e6-23c8-420e-aab3-ef776f2f02a0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.708792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.709314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 814/1626] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:36.713475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.713623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.713985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.714335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] PATH_INFO: `/v3/projects/0e4873e0dbb245ec9f79cca49cd8f4f5/users/4980b113f7e949bca0efc81c7e2d1de5/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.739927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4873e0dbb245ec9f79cca49cd8f4f5, user_id=4980b113f7e949bca0efc81c7e2d1de5, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.744711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a633c2-d0bd-4d23-8e17-70a16adac959 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:36.747113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5784e-49a0-41fd-a052-69b9d9d3b779 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.774995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:36.776001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.776400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.776753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] PATH_INFO: `/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c/users/59291a8fb5b34436ad28ec9375cb4576/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.805695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=663dc80b9cfd477cb61a4ffef0147a3c, user_id=59291a8fb5b34436ad28ec9375cb4576, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:36.808657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:36.871755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 813/1627] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:36 2022] PUT /identity/v3/projects/0e4873e0dbb245ec9f79cca49cd8f4f5/users/4980b113f7e949bca0efc81c7e2d1de5/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:36.885058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10434-1d33-41a6-bba1-fc8ce7953ab9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:36.885161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10434-1d33-41a6-bba1-fc8ce7953ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:36.885418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10434-1d33-41a6-bba1-fc8ce7953ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:36.938209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 815/1628] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:36 2022] PUT /identity/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c/users/59291a8fb5b34436ad28ec9375cb4576/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:36.939178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:36.941212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cbb10434-1d33-41a6-bba1-fc8ce7953ab9 None None] MFA Rules not processed for user `4980b113f7e949bca0efc81c7e2d1de5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:36.945654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cbb10434-1d33-41a6-bba1-fc8ce7953ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:37.067741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a327f-c2af-4546-99d4-ac5ae9748a2b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.077413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.078213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.078510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.078885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.080858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:37.084534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1778-5a42-4149-9321-9e395e4b1889 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:37.104270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 816/1629] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:37.106084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcecb31-0041-41f2-aea9-6292b92c95c5 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.107302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcecb31-0041-41f2-aea9-6292b92c95c5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.107665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcecb31-0041-41f2-aea9-6292b92c95c5 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.109337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 817/1630] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 5 12:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:37.110559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcecb31-0041-41f2-aea9-6292b92c95c5 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.127570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcecb31-0041-41f2-aea9-6292b92c95c5 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.133930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.134946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.135298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.135588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] PATH_INFO: `/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c/users/59291a8fb5b34436ad28ec9375cb4576/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.137033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 814/1631] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:37.142622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663dc80b9cfd477cb61a4ffef0147a3c, user_id=59291a8fb5b34436ad28ec9375cb4576, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:37.143017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9a8c-e54f-47d0-a2c1-4e25770e6a91 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.143426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9a8c-e54f-47d0-a2c1-4e25770e6a91 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.143837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e9a8c-e54f-47d0-a2c1-4e25770e6a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.145727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:37.158984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 818/1632] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:37 2022] PUT /identity/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c/users/59291a8fb5b34436ad28ec9375cb4576/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:37.159947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.186588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-360e9a8c-e54f-47d0-a2c1-4e25770e6a91 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:37.188072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-360e9a8c-e54f-47d0-a2c1-4e25770e6a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:37.322717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0f7da-af24-4765-a630-c7ed44b31403 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.340659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.341980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.342274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.342564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.343262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:37.345265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:37.367743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:37.402985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 815/1633] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:37.417348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.417950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.419740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.485482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] MFA Rules not processed for user `59291a8fb5b34436ad28ec9375cb4576`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:37.491114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:37.503258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 819/1634] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:37.504643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.623919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2d1d-fcac-452f-be70-f7d8155d31de admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.629731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.630412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.630698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.630974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.636552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:37.661344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 816/1635] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:37.664820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.710515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bebec1-90fa-4fd7-8c30-f71d134f2cea None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.806762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:37.807405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:37.831935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 820/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:37.834107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.838631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.839225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.839514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.839790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.840520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:37.845919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:37.855284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1a29-3cbf-46da-b7b8-ee5f0be4fc6a service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.865589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.866260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.866548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.866827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:37.949011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 817/1637] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:37 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:37.950629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:37.988830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69725-d439-473f-b813-3c267bedd67c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:37.996072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:37.996958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:37.997641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:37.998027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:38.000054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:38.001135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:38.002758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:38.003832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:38.094380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 818/1638] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:58:38.094380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:38.097161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 821/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:38.097374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30b7c-2305-4967-a5c8-9579187dc662 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:38.097374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:38.097374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:38.097374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:38.097716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] PATH_INFO: `/v3/projects/a11b90c6197540b29866669cb4bddb75/users/fed2b0de4fba42299d7e9f44cd503b4d/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:38.104547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11b90c6197540b29866669cb4bddb75, user_id=fed2b0de4fba42299d7e9f44cd503b4d, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:38.108737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:38.188014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 819/1640] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:38 2022] PUT /identity/v3/projects/a11b90c6197540b29866669cb4bddb75/users/fed2b0de4fba42299d7e9f44cd503b4d/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:38.193517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:38.211390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887a5a-edff-4163-a1d2-7515bca280d5 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:38.315740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:38.318504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:38.319071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:38.319593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:38.320876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:38.323038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb509cc-d2ae-467e-b263-c2184c6007ee admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:38.338603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 822/1641] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:38.343167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:38.359154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a3aa1-8b27-4734-b328-e5aad713c5dc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:38.373644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:38.373644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:38.373644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:38.373644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] PATH_INFO: `/v3/projects/a11b90c6197540b29866669cb4bddb75/users/fed2b0de4fba42299d7e9f44cd503b4d/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:38.378429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11b90c6197540b29866669cb4bddb75, user_id=fed2b0de4fba42299d7e9f44cd503b4d, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:38.382711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:38.406973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 820/1642] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:38 2022] PUT /identity/v3/projects/a11b90c6197540b29866669cb4bddb75/users/fed2b0de4fba42299d7e9f44cd503b4d/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:58:38.411527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:38.411889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:38.412558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:38.451634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] MFA Rules not processed for user `fed2b0de4fba42299d7e9f44cd503b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:38.453228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:38.643842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 823/1643] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:38.711123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:38.871997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:39.183526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ca3be-8003-48b6-82e4-91132da5f748 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:39.183526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:39.183526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.183526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.189084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.189084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:39.189084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299586-3670-4446-8f75-fd068b3d683e service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:39.189084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 821/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:39.191205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:39.208652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db4e79-1b79-4e95-b6da-46f295e8f8bc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:39.219232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:39.220336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.222238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.222649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.323660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136755a-39c0-4a98-95ea-5b7425c70654 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.324378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136755a-39c0-4a98-95ea-5b7425c70654 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.324665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136755a-39c0-4a98-95ea-5b7425c70654 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.326418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 822/1645] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 5 12:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:39.351312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02be1-a4c5-4f61-bf44-e8d429ba7aee None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.360886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02be1-a4c5-4f61-bf44-e8d429ba7aee None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.360886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02be1-a4c5-4f61-bf44-e8d429ba7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.364284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:39.365890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499f28-7a97-4bfb-ac52-faa9d1bdcd04 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:39.386658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 824/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:58:39.404824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:39.429652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cee02be1-a4c5-4f61-bf44-e8d429ba7aee None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:39.433437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cee02be1-a4c5-4f61-bf44-e8d429ba7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:39.625259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 823/1647] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 5 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:39.626694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2faf9-b154-4383-a4aa-031ac8f90845 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.627097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2faf9-b154-4383-a4aa-031ac8f90845 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.627495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2faf9-b154-4383-a4aa-031ac8f90845 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.629284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 825/1648] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 5 12:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:39.635437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.635738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.636182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.670450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:39.671900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:39.703297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 824/1649] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:39.775563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2faf9-b154-4383-a4aa-031ac8f90845 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:39.792571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2faf9-b154-4383-a4aa-031ac8f90845 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:39.803217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:39.805616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:39.805933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:39.807430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:39.842729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:39.846494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52920890-8188-4dad-981d-ceeebcbab838 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:39.889060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 826/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:40.268521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:40.415045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42ff06-c61e-4f5b-8ceb-4b8eb214fbb5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:40.425263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:40.426185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:40.427084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:40.430185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] PATH_INFO: `/v3/users/565b60f6e81348c1b9c98ba1f4fedd08` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:40.433628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565b60f6e81348c1b9c98ba1f4fedd08)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:40.435331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: WARNING py.warnings [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:40.435331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: warnings.warn(msg) Jul 05 12:58:40.435331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: Jul 05 12:58:40.442684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:40.824728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565b60f6e81348c1b9c98ba1f4fedd08'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:40.826967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565b60f6e81348c1b9c98ba1f4fedd08'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:40.829597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565b60f6e81348c1b9c98ba1f4fedd08'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:40.856880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565b60f6e81348c1b9c98ba1f4fedd08'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:40.929371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565b60f6e81348c1b9c98ba1f4fedd08'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:40.984412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 825/1651] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:40 2022] DELETE /identity/v3/users/565b60f6e81348c1b9c98ba1f4fedd08 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:40.989182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:40.994050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:40.994050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:41.042183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:41.049715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:41.085379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:41.240123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 827/1652] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:41.269257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:41.273597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:41.366586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:41.542729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837de-8387-4021-bd40-6737f55328a8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:41.567115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:41.568518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:41.572551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:41.572551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:41.614984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:41.616656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bc824-3e55-4d1c-afe7-f4de913aaecc service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:41.667414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 826/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:43.110927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:43.112777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:43.140201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ab5c1-78e3-426d-860f-8f7d4b9307cb None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:43.154182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:43.155392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:43.155824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:43.156242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] PATH_INFO: `/v3/users/a31db81d1da841d28fb371846b468e30` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:43.157938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31db81d1da841d28fb371846b468e30)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:43.160480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:43.422167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31db81d1da841d28fb371846b468e30'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:43.442051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31db81d1da841d28fb371846b468e30'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:43.448659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31db81d1da841d28fb371846b468e30'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:43.449604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31db81d1da841d28fb371846b468e30'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:43.548090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a35d5308-84f5-4ac1-bf8d-b589d39f1547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31db81d1da841d28fb371846b468e30'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:43.607784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 828/1654] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:43 2022] DELETE /identity/v3/users/a31db81d1da841d28fb371846b468e30 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:43.614048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:43.614987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:43.615479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:43.687830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:43.690570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:43.772443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:43.772767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:43.773056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:43.844642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] MFA Rules not processed for user `b75999cf46b744d2b5623c5615db2401`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:43.846248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:43.878071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 827/1655] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:43.887318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:43.889445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:44.029877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8657-302f-45ee-afa5-3137bfea87d9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:44.041419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:44.041419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:44.041780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:44.042027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:44.062997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:44.064485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:44.092755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 828/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:44.130706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 829/1657] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:44.141010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:44.142514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:44.291047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:44.333511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12069-4560-482c-bf02-96f88b20a08c service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:44.346348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:44.348392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:44.348392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:44.348392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:44.369574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:44.377243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:44.397816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 829/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:44.664245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:44.670355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:44.709412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e641b5e-9fef-44f1-af96-b1726f3d0049 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:44.721827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:44.723163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:44.723684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:44.724417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] PATH_INFO: `/v3/projects/bb058227f48841188cd7738b3da8fb4f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:44.726463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb058227f48841188cd7738b3da8fb4f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:44.728192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: WARNING py.warnings [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:44.728192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: warnings.warn(msg) Jul 05 12:58:44.728192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: Jul 05 12:58:44.730479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:44.795161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:45.036326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb058227f48841188cd7738b3da8fb4f', 'request_id': 'req-cbe5c6ee-0822-43ed-8fbe-1856174580ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.110940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb058227f48841188cd7738b3da8fb4f', 'request_id': 'req-cbe5c6ee-0822-43ed-8fbe-1856174580ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.128181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb058227f48841188cd7738b3da8fb4f', 'request_id': 'req-cbe5c6ee-0822-43ed-8fbe-1856174580ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.141524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] The token cache is being invalidate because project bb058227f48841188cd7738b3da8fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:45.142535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.143741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.146800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 830/1659] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:44 2022] DELETE /identity/v3/projects/bb058227f48841188cd7738b3da8fb4f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:45.151037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:45.165392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c07e2-1d90-4997-b81d-c34a1c80c031 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:45.318201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:45.319413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:45.319884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:45.320378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] PATH_INFO: `/v3/users/59291a8fb5b34436ad28ec9375cb4576` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:45.323650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59291a8fb5b34436ad28ec9375cb4576)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:45.332416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:45.618953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59291a8fb5b34436ad28ec9375cb4576'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.622463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59291a8fb5b34436ad28ec9375cb4576'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.623727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59291a8fb5b34436ad28ec9375cb4576'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.652961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59291a8fb5b34436ad28ec9375cb4576'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.702731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:45.706119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:45.729559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c6ee-0822-43ed-8fbe-1856174580ba admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:45.736750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:45.738112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:45.739130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:45.739571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] PATH_INFO: `/v3/projects/d43a6a28acd74773a12db34c55fae672` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:45.741366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43a6a28acd74773a12db34c55fae672)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:45.746448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:45.765141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e7b39ea4-9534-499f-8da9-67acc5aaa686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59291a8fb5b34436ad28ec9375cb4576'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:45.806687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 830/1660] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:45 2022] DELETE /identity/v3/users/59291a8fb5b34436ad28ec9375cb4576 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:45.938389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43a6a28acd74773a12db34c55fae672', 'request_id': 'req-f8b40945-dc7a-4366-b69c-9f7ca17044ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:46.117493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43a6a28acd74773a12db34c55fae672', 'request_id': 'req-f8b40945-dc7a-4366-b69c-9f7ca17044ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:46.117493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43a6a28acd74773a12db34c55fae672', 'request_id': 'req-f8b40945-dc7a-4366-b69c-9f7ca17044ba'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:46.131262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] The token cache is being invalidate because project d43a6a28acd74773a12db34c55fae672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:46.131568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:46.132496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8b40945-dc7a-4366-b69c-9f7ca17044ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:46.137720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 831/1661] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:45 2022] DELETE /identity/v3/projects/d43a6a28acd74773a12db34c55fae672 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:46.142957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.143202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.143490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.189822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:46.196794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:46.317951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 831/1662] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:46.327393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.328272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.328792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.351949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:46.354264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:46.373463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 832/1663] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:46.373625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:46.379013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:46.385608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685a5ce-07e4-4c4d-a5c1-d8d12b70747c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:46.392655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:46.396424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.396424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.396424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.397201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:46.397658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:46.399823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:46.419365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 832/1664] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:58:46.423937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:46.441470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d951343-b9ba-479e-9c19-8402b4092c7f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:46.453847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:46.454740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.455133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.455515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.459174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:46.461426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:46.592265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 833/1665] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:46 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:46.596345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:46.610307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42eb2a-c915-48f6-860f-758a5d33310a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:46.756250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:46.757228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.757673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.758416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.760889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:46.776281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:46.955785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 833/1666] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:46 2022] POST /identity/v3/users => generated 287 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:46.960058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:46.980057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0015-4944-484e-81c7-16a3c0c09647 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:46.990726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:46.991590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:46.992025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:46.992772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:46.995015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:47.001541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:47.032771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:47.037162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 834/1667] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:47.038211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.038415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:47.053799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1013a-aa2c-495a-9877-f339c94119c7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:47.058869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:47.060279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca3d78-6aa2-46b6-b654-d58823a05596 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:47.061043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.061833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.062393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.063614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:47.065863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:47.068448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:47.070042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.070388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.070900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] PATH_INFO: `/v3/users/fd274df17fe8496aa3ef04b912a14005` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.072223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd274df17fe8496aa3ef04b912a14005)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:47.076318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:47.085853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 835/1668] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:47.087157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:47.092440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.155357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01060b-fddd-4835-83dd-fef752b1d88b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:47.169673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:47.170918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.171416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.178182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] PATH_INFO: `/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.187434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=663dc80b9cfd477cb61a4ffef0147a3c)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:47.187434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:47.292025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd274df17fe8496aa3ef04b912a14005'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.293464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd274df17fe8496aa3ef04b912a14005'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.295597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd274df17fe8496aa3ef04b912a14005'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.307655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd274df17fe8496aa3ef04b912a14005'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.329183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:47.351790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663dc80b9cfd477cb61a4ffef0147a3c', 'request_id': 'req-05007f8a-61a4-4455-b89f-e89080e3edbf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.409928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd274df17fe8496aa3ef04b912a14005'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.471234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663dc80b9cfd477cb61a4ffef0147a3c', 'request_id': 'req-05007f8a-61a4-4455-b89f-e89080e3edbf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.479203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 834/1669] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:47 2022] DELETE /identity/v3/users/fd274df17fe8496aa3ef04b912a14005 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:58:47.484503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663dc80b9cfd477cb61a4ffef0147a3c', 'request_id': 'req-05007f8a-61a4-4455-b89f-e89080e3edbf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.496423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:47.499079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.529146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] The token cache is being invalidate because project 663dc80b9cfd477cb61a4ffef0147a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:47.529492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.536396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-05007f8a-61a4-4455-b89f-e89080e3edbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:47.538104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 836/1670] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:47 2022] DELETE /identity/v3/projects/663dc80b9cfd477cb61a4ffef0147a3c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:47.546368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda94eae-b781-4b25-9193-9e543ec04190 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.546368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda94eae-b781-4b25-9193-9e543ec04190 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.546368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda94eae-b781-4b25-9193-9e543ec04190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.604213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cda94eae-b781-4b25-9193-9e543ec04190 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:47.605500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cda94eae-b781-4b25-9193-9e543ec04190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.663518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab2aa-b105-4b01-a75f-811bf5f2ff12 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:47.670663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:47.671880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.672368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.672859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] PATH_INFO: `/v3/projects/9216f3d4d3d749018005e43667f04b68/users/7a2f9ccc2f0f4fa792533f61e9888853/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.692448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9216f3d4d3d749018005e43667f04b68, user_id=7a2f9ccc2f0f4fa792533f61e9888853, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:47.697306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c90a9-c63d-427f-8729-4f24f6381abe admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:47.796065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 835/1671] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:47 2022] PUT /identity/v3/projects/9216f3d4d3d749018005e43667f04b68/users/7a2f9ccc2f0f4fa792533f61e9888853/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:47.797562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.797933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.798896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.822994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 837/1672] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:47.822994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:47.822994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:47.822994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:47.868054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:47.883774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.888820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] MFA Rules not processed for user `7a2f9ccc2f0f4fa792533f61e9888853`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:47.890043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:47.989014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 838/1673] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:47.990005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.000294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:48.015495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:48.022049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 836/1674] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:48.022049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.032375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:48.098075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc91eef-5e2f-40c1-b2f0-49d778f40cd8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.104950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.109032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.109032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.109032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.122971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:48.125329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b89-1306-4e01-9e71-f3bb2e8750e1 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:48.141828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 839/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:48.149627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.150207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.150714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.191665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:48.195855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:48.218185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 840/1676] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:48.225522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.255199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64746175-6872-453b-bd96-8cf53886eb70 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.280313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0571f-e7e9-41c7-b6e8-d07705508d4d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.286757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.288141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.288434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.289207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.296917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.298553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.300271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.300654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.301596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:48.311162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:48.315384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:48.317125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:48.317245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:48.341085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 837/1677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:48.377070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 841/1678] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:48.380313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.402201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a75e8-16f2-4d71-931a-f2d60ae8d752 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.417054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.417054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.417054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.417054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.418512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:48.420919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:48.562123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 838/1679] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:48 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:48.566721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.581391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbdbf-2e25-4d5c-b210-fe5becc9b673 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.797488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:48.810714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:48.812593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:48.876589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.891919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.894384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:48.895024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:48.896734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:48.900964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:48.999979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68eb74-ebf7-49ca-b13a-09e367ef36e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:48.999979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:48.999979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:48.999979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.000644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] PATH_INFO: `/v3/users/7a2f9ccc2f0f4fa792533f61e9888853` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.000644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2f9ccc2f0f4fa792533f61e9888853)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:49.000644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:49.095047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 842/1680] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:48 2022] POST /identity/v3/users => generated 288 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:49.096356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:49.114323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9ba5-9529-438c-97e9-dfcb8fbf1e19 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:49.161916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:49.161916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.163226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.165409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.169028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:49.172298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:49.215590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 843/1681] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:49.218917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:49.240866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502408cb-1dde-43f4-83f4-0698f6f60bcd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:49.256864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:49.257930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.259542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.259995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.262544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:49.273408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:49.295184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2f9ccc2f0f4fa792533f61e9888853'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:49.296890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2f9ccc2f0f4fa792533f61e9888853'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:49.300624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2f9ccc2f0f4fa792533f61e9888853'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:49.326814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 844/1682] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:49.333449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:49.333630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2f9ccc2f0f4fa792533f61e9888853'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:49.336833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:49.361617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22002b-814d-4c56-8aa7-874c53c6cb56 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:49.368100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:49.369432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.369877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.370575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] PATH_INFO: `/v3/projects/d37c051f103a4f0fa33ea543d11b763e/users/789f8a19a737437283d4b286ee9e47bb/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.389467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37c051f103a4f0fa33ea543d11b763e, user_id=789f8a19a737437283d4b286ee9e47bb, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:49.393990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94e13-99fa-47f2-ab03-4b69a6a7359e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:49.411466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c63dfb1d-a46a-49a7-bbb4-30d766adfe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2f9ccc2f0f4fa792533f61e9888853'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:49.454053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 839/1683] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:48 2022] DELETE /identity/v3/users/7a2f9ccc2f0f4fa792533f61e9888853 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:58:49.455861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.456166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.456461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.497082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 845/1684] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:49 2022] PUT /identity/v3/projects/d37c051f103a4f0fa33ea543d11b763e/users/789f8a19a737437283d4b286ee9e47bb/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:49.509679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.510142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.510584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.520269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:49.523813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:49.637320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] MFA Rules not processed for user `789f8a19a737437283d4b286ee9e47bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:49.644291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:49.746321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:49.822001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 840/1685] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:49.835321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:49.838852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:49.897212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 846/1686] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:49.898318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:49.939352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf4bf-08b9-433b-8576-b3802adee871 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:49.951377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:49.952194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:49.952481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:49.952785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:49.953928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:49.959374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c112-53e7-4477-95fb-ae79c5ade25b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:50.027635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b2ba2-8a4e-44e1-98d1-bc6ffd0c4c35 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:50.036225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:50.036225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:50.036225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:50.036225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:50.051429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:50.055905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:50.079017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 841/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:50.114226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 847/1688] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:49 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:50.115844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:50.154211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af835fe-d154-462c-8caf-fa41d921f7a6 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:50.324401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:50.324972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:50.325593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:50.356587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:50.361140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:50.361443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:50.361735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:50.362479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:50.372507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:50.421897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] MFA Rules not processed for user `a426eed4598345878445c6ba2ab913d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:50.421897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:50.539897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:50.553485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 842/1689] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:50 2022] POST /identity/v3/users => generated 295 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:50.556800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:50.566930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:50.615708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a103aa-2b8e-45bb-99a7-19bd851ebf97 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:50.649698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:50.650502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:50.650800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:50.651086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] PATH_INFO: `/v3/projects/8f439f3777164bf28f3b80489f7224ef` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:50.656892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f439f3777164bf28f3b80489f7224ef)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:50.673865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 848/1690] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:50.675493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:50.677368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:50.753711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9a87-beed-4dda-9618-dd34cc8b16c0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:50.771720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:50.773404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:50.774047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:50.774537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:50.775498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:50.789124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:50.807895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 849/1691] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:50.807895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:50.812472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:50.965206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f439f3777164bf28f3b80489f7224ef', 'request_id': 'req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.029328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915f629-ca03-43b9-bd13-85718365f92e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:51.077019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f439f3777164bf28f3b80489f7224ef', 'request_id': 'req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.080025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:51.097466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f439f3777164bf28f3b80489f7224ef', 'request_id': 'req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.126026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] The token cache is being invalidate because project 8f439f3777164bf28f3b80489f7224ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:51.126375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.127057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.129161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 843/1692] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:50 2022] DELETE /identity/v3/projects/8f439f3777164bf28f3b80489f7224ef => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:51.130305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:51.134870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:51.208160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:51.209219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.209583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.210029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.214885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:51.274113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9f06-275b-42c5-a1e8-4e0fbc70ce77 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:51.290413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:51.305741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.306095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.308313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] PATH_INFO: `/v3/projects/c522e81f51c6446dacc96f0d30254f14/users/762ebc2ec2ee4abaa4146ececd9fed85/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.334125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c522e81f51c6446dacc96f0d30254f14, user_id=762ebc2ec2ee4abaa4146ececd9fed85, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:51.337728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa596-71e0-4b2d-b209-048a2edcb142 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:51.404440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:51.406437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:51.422050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 850/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:51.429838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:51.429838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:51.430059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 844/1694] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:51 2022] PUT /identity/v3/projects/c522e81f51c6446dacc96f0d30254f14/users/762ebc2ec2ee4abaa4146ececd9fed85/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:51.430059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.430059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.430059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.443136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842b7a-55c4-4ce5-b362-cad3e2cf985e service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:51.502090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] MFA Rules not processed for user `ea86039e70904324ada4fd2cd9be754e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:51.504570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:51.591628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:51.593854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.594244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.594628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] PATH_INFO: `/v3/users/4980b113f7e949bca0efc81c7e2d1de5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.599240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4980b113f7e949bca0efc81c7e2d1de5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:51.602082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:51.715538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 845/1695] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:51.716605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:51.741216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563423-c877-4492-9fb1-319dc0478cfc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:51.748002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:51.748891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.749319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.750142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.750689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:51.754193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37017b-2142-4d27-ab01-9f50f942eb76 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:51.758105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:51.781881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 846/1696] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:51.790355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.791849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.792239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.822519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] MFA Rules not processed for user `ea86039e70904324ada4fd2cd9be754e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:51.824782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:51.846973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 847/1697] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:51.846973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:51.873265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc9ac-7de8-4c80-b4be-279f25db2f55 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:51.880700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4980b113f7e949bca0efc81c7e2d1de5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.881819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:51.882771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:51.883059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:51.883342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] PATH_INFO: `/v3/projects/c522e81f51c6446dacc96f0d30254f14/users/762ebc2ec2ee4abaa4146ececd9fed85/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:51.888714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c522e81f51c6446dacc96f0d30254f14, user_id=762ebc2ec2ee4abaa4146ececd9fed85, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:51.893118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4980b113f7e949bca0efc81c7e2d1de5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.894319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4980b113f7e949bca0efc81c7e2d1de5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.896125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4980b113f7e949bca0efc81c7e2d1de5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:51.897526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:51.922898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 848/1698] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:51 2022] PUT /identity/v3/projects/c522e81f51c6446dacc96f0d30254f14/users/762ebc2ec2ee4abaa4146ececd9fed85/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:51.925001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:51.927289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.002807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4980b113f7e949bca0efc81c7e2d1de5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.046272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5536-e9fe-4ce7-9c5b-ed2588971b98 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:52.046397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 851/1699] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:51 2022] DELETE /identity/v3/users/4980b113f7e949bca0efc81c7e2d1de5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:52.046823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:52.048998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.221218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dde6eb-0f89-44b5-9a7d-c4e4e873eff1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:52.225504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:52.226634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.226947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.227251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.237916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.238888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:52.243017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.243527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.244346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] PATH_INFO: `/v3/projects/9216f3d4d3d749018005e43667f04b68` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.263654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9216f3d4d3d749018005e43667f04b68)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:52.266545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:52.345193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:52.347632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad59fd-482e-44ba-ba00-c99b1b8626f7 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:52.365496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 849/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:52.367514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.367907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.368429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.482954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9216f3d4d3d749018005e43667f04b68', 'request_id': 'req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.506335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] MFA Rules not processed for user `762ebc2ec2ee4abaa4146ececd9fed85`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:52.509822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.569265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9216f3d4d3d749018005e43667f04b68', 'request_id': 'req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.579059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9216f3d4d3d749018005e43667f04b68', 'request_id': 'req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.608964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] The token cache is being invalidate because project 9216f3d4d3d749018005e43667f04b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:52.610675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.613306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d53c7ef-cfd2-416d-9630-9ad9b09d27cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:52.621424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 852/1701] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:52 2022] DELETE /identity/v3/projects/9216f3d4d3d749018005e43667f04b68 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:52.625270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ac069-86e6-4e39-b39f-cd55a3b4637c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.625789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ac069-86e6-4e39-b39f-cd55a3b4637c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.626444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ac069-86e6-4e39-b39f-cd55a3b4637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.664502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c79ac069-86e6-4e39-b39f-cd55a3b4637c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:52.669041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c79ac069-86e6-4e39-b39f-cd55a3b4637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.694094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 850/1702] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:52.709181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:52.712015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.837927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 853/1703] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:52.841640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.841999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.842295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.914086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:52.915659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.936312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b18cf5-113f-4814-be3a-82814ee6ba5c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:52.946112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 854/1704] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:52.947219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:52.950526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:52.955216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.955902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.956342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.961079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:52.961214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a479-031b-4623-af5b-fea5f435b7e6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:52.987613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:52.988970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:52.989474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:52.992919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:52.996027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:52.998653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.001824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.037605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 855/1705] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:53.041916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.065756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bae95-9093-4823-8781-058031b5787c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.074733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.078721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.079018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.079303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.081687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.085984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7479-7fde-4a93-89af-c70529232679 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.103256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.103256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.112718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 851/1706] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:53.127641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:53.236827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 856/1707] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:53 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:53.246226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.265985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:53.266848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95404-5a38-4690-8bf7-5cb47291568e service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.427618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.432160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.432160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.432160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.432160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.432160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa12a83-ff93-472d-903d-ef03a374841d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.540689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37031-5bfd-44d4-80af-9cd77c36352f None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.542988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37031-5bfd-44d4-80af-9cd77c36352f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.542988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37031-5bfd-44d4-80af-9cd77c36352f None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.544360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 852/1708] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:53 2022] POST /identity/v3/users => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:53.545718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 857/1709] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 5 12:58:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:53.548536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb37031-5bfd-44d4-80af-9cd77c36352f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.552095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.552553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.552874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.566111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb37031-5bfd-44d4-80af-9cd77c36352f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.574177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.577466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.578080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.578793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.579758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.582772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.619250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 858/1710] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:53.621274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.626957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:53.655664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee82da-1590-43da-8a6c-b0337c934997 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.658622 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:53.660417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:53.661316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.662415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.662742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.663035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] PATH_INFO: `/v3/users/0bd8659f2f634e18836fc1203fde25c5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.664620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd8659f2f634e18836fc1203fde25c5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.666947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.776191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:58:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:58:53.777334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.791943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20955-b686-4d4f-a5c6-bd456fc1e5bf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.801257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.801891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.802254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.802608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.803618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.805447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.820825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 854/1712] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:53.820825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.820825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:53.837387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31414f-3f0f-4e17-85c0-a866395d8873 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.841493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.842240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.842640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.843106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.852384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.854133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:53.871124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 855/1713] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:53.873042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:53.894358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780e58-50a4-4be4-aa41-37c49d28ee82 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:53.895893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd8659f2f634e18836fc1203fde25c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:53.906005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:53.906249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd8659f2f634e18836fc1203fde25c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:53.906806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd8659f2f634e18836fc1203fde25c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:53.906927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:53.907177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:53.907430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd8659f2f634e18836fc1203fde25c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:53.907556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] PATH_INFO: `/v3/projects/221485d8a70249c59797d4fc4e713ec1/users/f3e3f42b51534a68aa7beb883ace74cd/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:53.925638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221485d8a70249c59797d4fc4e713ec1, user_id=f3e3f42b51534a68aa7beb883ace74cd, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:53.928409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:54.005997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d0d1a96-9220-4bf3-8e3d-3aad1fce1b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd8659f2f634e18836fc1203fde25c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.047109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 856/1714] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:53 2022] PUT /identity/v3/projects/221485d8a70249c59797d4fc4e713ec1/users/f3e3f42b51534a68aa7beb883ace74cd/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:54.048486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:54.057665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.065741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 859/1715] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:53 2022] DELETE /identity/v3/users/0bd8659f2f634e18836fc1203fde25c5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:54.071939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6c65-b477-481b-a632-ba2e0d011a32 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.071939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6c65-b477-481b-a632-ba2e0d011a32 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.071939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6c65-b477-481b-a632-ba2e0d011a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.197624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-498e6c65-b477-481b-a632-ba2e0d011a32 None None] MFA Rules not processed for user `f3e3f42b51534a68aa7beb883ace74cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:54.197624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-498e6c65-b477-481b-a632-ba2e0d011a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.218375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166072-afc3-46d9-87b1-7be3c6d107e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:54.348506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:54.349814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.350118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.350401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] PATH_INFO: `/v3/projects/0e4873e0dbb245ec9f79cca49cd8f4f5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.351849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4873e0dbb245ec9f79cca49cd8f4f5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:54.354480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:54.376760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 860/1716] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:54.377930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ddc7b-cdc0-4dc4-a1db-d21353db0b45 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.378224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ddc7b-cdc0-4dc4-a1db-d21353db0b45 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.378520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ddc7b-cdc0-4dc4-a1db-d21353db0b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.421879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-137ddc7b-cdc0-4dc4-a1db-d21353db0b45 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:54.426132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-137ddc7b-cdc0-4dc4-a1db-d21353db0b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.451960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 861/1717] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:54.451960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.451960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.451960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.505499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] MFA Rules not processed for user `b75999cf46b744d2b5623c5615db2401`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:54.506935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.578745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4873e0dbb245ec9f79cca49cd8f4f5', 'request_id': 'req-c217a4d0-3d4b-43db-9bf2-648407c09b40'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.694593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4873e0dbb245ec9f79cca49cd8f4f5', 'request_id': 'req-c217a4d0-3d4b-43db-9bf2-648407c09b40'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.703815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4873e0dbb245ec9f79cca49cd8f4f5', 'request_id': 'req-c217a4d0-3d4b-43db-9bf2-648407c09b40'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.720085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] The token cache is being invalidate because project 0e4873e0dbb245ec9f79cca49cd8f4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:54.720466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.722777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:54.730491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 857/1718] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:54 2022] DELETE /identity/v3/projects/0e4873e0dbb245ec9f79cca49cd8f4f5 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:54.730491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:54.734419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.761017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 862/1719] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:54.761953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:54.770070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.963419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a4d0-3d4b-43db-9bf2-648407c09b40 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:54.965792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:54.968644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61522c2-779d-4adb-a201-ba0c348cebbf None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:54.976868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:54.981772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.982088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.982384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.986703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:54.994216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:55.099247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:55.101282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.101605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.101893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.107388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.138365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:55.140103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf35a-9ea5-45fa-b228-b018045f3021 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:55.170919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 858/1720] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:54 2022] POST /identity/v3/projects => generated 405 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:55.177302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:55.180936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.184160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 863/1721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:55.186893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d927-a53e-4efd-9521-c0e0257c78f0 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.187186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d927-a53e-4efd-9521-c0e0257c78f0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.187455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d927-a53e-4efd-9521-c0e0257c78f0 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.191723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 864/1722] 10.222.0.25 () {54 vars in 960 bytes} [Tue Jul 5 12:58:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:55.206644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.207008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.207294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.212318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:55.284277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] MFA Rules not processed for user `faa03e9023bb4b7a84cee7fa85bcf1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:55.286348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.373595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d55f4-0b96-4fea-9a9e-e73ba35f455b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:55.382837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:55.386428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.386766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.387082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] PATH_INFO: `/v3/users/fed2b0de4fba42299d7e9f44cd503b4d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.391101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed2b0de4fba42299d7e9f44cd503b4d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:55.398246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:55.472442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 865/1723] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:55.480384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:55.493927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d739c9b-5858-4bc6-b9ae-3faac81e35e2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:55.502654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:55.503402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.503402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.503649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.504494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:55.506685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe769b-d647-4703-8f0d-c7b2233124a3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:55.604565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed2b0de4fba42299d7e9f44cd503b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:55.605169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed2b0de4fba42299d7e9f44cd503b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:55.605652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed2b0de4fba42299d7e9f44cd503b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:55.614305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed2b0de4fba42299d7e9f44cd503b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:55.628100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 866/1724] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:55 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:55.628100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.628100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.628100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.650879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:55.652722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.730443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed2b0de4fba42299d7e9f44cd503b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:55.759620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 859/1725] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:55 2022] DELETE /identity/v3/users/fed2b0de4fba42299d7e9f44cd503b4d => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:55.760643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:55.765927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.807017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 867/1726] 10.222.0.25 () {58 vars in 1057 bytes} [Tue Jul 5 12:58:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:55.814857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:55.825390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:55.831004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.883775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08808e36-a8a5-488e-a9ae-ce936ede2fcb None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:55.955696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e999-e318-4255-9ccf-b194f9e223af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:55.981509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:55.983830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.983830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.983830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.990921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.083868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.087167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.089735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.090862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.093167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.097831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.118451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 868/1727] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:56.120574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:56.146897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.149255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74e08-fd67-4acc-86b8-fcec647735cf service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.174977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 860/1728] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:56.177098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707f96-4826-435e-a5e2-6d63c12a00e8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.180170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707f96-4826-435e-a5e2-6d63c12a00e8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.180481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707f96-4826-435e-a5e2-6d63c12a00e8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.185455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 861/1729] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 5 12:58:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:56.188101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707f96-4826-435e-a5e2-6d63c12a00e8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:56.221976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707f96-4826-435e-a5e2-6d63c12a00e8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:56.238164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.239052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.239345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.239627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] PATH_INFO: `/v3/projects/622497f2d1a3403893216d176bbe430f/users/f906038cd0784c8cab49578d46642284/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.299359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671b51-5991-40a2-97b3-b391734fdb98 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:56.303372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=622497f2d1a3403893216d176bbe430f, user_id=f906038cd0784c8cab49578d46642284, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.306211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861d815-7846-4663-8158-a4b488800b2a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.322967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.334707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.334707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.334707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.337206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.370080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.381086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.417046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 862/1730] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:56 2022] PUT /identity/v3/projects/622497f2d1a3403893216d176bbe430f/users/f906038cd0784c8cab49578d46642284/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:56.420187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.420187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.420187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.428464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 869/1731] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:56.429816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:56.447023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefcd54-522d-4370-b7f4-00bf667c498c service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:56.474910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:56.509394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:56.513625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.633681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.634500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.638250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.638779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.639976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.641489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.658911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 870/1732] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:56.667691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:56.674439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 863/1733] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:56.689002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0d893-d821-48fc-8377-6b886495ba8b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:56.697055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.706079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.706079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.709722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] PATH_INFO: `/v3/projects/622497f2d1a3403893216d176bbe430f/users/f906038cd0784c8cab49578d46642284/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.710851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622497f2d1a3403893216d176bbe430f, user_id=f906038cd0784c8cab49578d46642284, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:56.714775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52202dd-261d-40ec-99aa-365060b1d863 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:56.719525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:56.721069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.752085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae4f3b-a553-4159-b0e4-02d4f9320344 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:56.783070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 871/1734] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:56 2022] PUT /identity/v3/projects/622497f2d1a3403893216d176bbe430f/users/f906038cd0784c8cab49578d46642284/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:56.797344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.797344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.798363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.888180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] MFA Rules not processed for user `f906038cd0784c8cab49578d46642284`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:56.891413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.896495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:56.963550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:56.978750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.979039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.979316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.008446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:57.017411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:57.091415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 864/1735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:58:57.091415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:57.100344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:57.228602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 872/1736] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:57.250852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:57.253515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:57.293585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dfec4-8aeb-4877-a10b-76604b274e78 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:57.300379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:57.304134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:57.304602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:57.305067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] PATH_INFO: `/v3/projects/5690b04a1d1e46a487f5f7519ca03f3d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.307427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5690b04a1d1e46a487f5f7519ca03f3d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:57.310737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:57.369062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506fa13-1e40-4771-b873-81d27f5f74c5 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:57.377818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:57.377818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:57.377818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:57.377818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.388915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:57.390696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd732c92-7af4-4bd8-adca-390f6a73d5b7 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:57.403122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 873/1737] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:58:57.490232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5690b04a1d1e46a487f5f7519ca03f3d', 'request_id': 'req-eb230855-f793-4f9e-a4f1-79043e2071d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:57.579893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5690b04a1d1e46a487f5f7519ca03f3d', 'request_id': 'req-eb230855-f793-4f9e-a4f1-79043e2071d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:57.589290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5690b04a1d1e46a487f5f7519ca03f3d', 'request_id': 'req-eb230855-f793-4f9e-a4f1-79043e2071d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:57.640045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] The token cache is being invalidate because project 5690b04a1d1e46a487f5f7519ca03f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:57.643587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:57.645170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:57.652529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 865/1738] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:57 2022] DELETE /identity/v3/projects/5690b04a1d1e46a487f5f7519ca03f3d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:57.657726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbf94-f5c9-4361-9815-1f238c8b304d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:57.658091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbf94-f5c9-4361-9815-1f238c8b304d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:57.658432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbf94-f5c9-4361-9815-1f238c8b304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.694106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:57.696133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:57.747191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a1cfbf94-f5c9-4361-9815-1f238c8b304d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:57.765215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a1cfbf94-f5c9-4361-9815-1f238c8b304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:57.853015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230855-f793-4f9e-a4f1-79043e2071d4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:57.879849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:57.881096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:57.881657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:57.882149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] PATH_INFO: `/v3/users/f3e3f42b51534a68aa7beb883ace74cd` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.884355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e3f42b51534a68aa7beb883ace74cd)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:57.892211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:57.936570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 874/1739] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:57.939117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:57.941024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:57.943166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:57.984686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:57.989414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.003519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 875/1740] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:58.004525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:58.006480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.028200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564de20d-1e6c-4cb1-805f-a133999d182b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:58.031103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:58.058208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:58.061364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.061633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.062721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] PATH_INFO: `/v3/projects/a11b90c6197540b29866669cb4bddb75` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.068860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11b90c6197540b29866669cb4bddb75)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:58.075300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:58.141444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e3f42b51534a68aa7beb883ace74cd'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.142111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e3f42b51534a68aa7beb883ace74cd'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.142939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e3f42b51534a68aa7beb883ace74cd'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.161080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e3f42b51534a68aa7beb883ace74cd'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.254894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e3f42b51534a68aa7beb883ace74cd'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.298199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 866/1741] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:58:57 2022] DELETE /identity/v3/users/f3e3f42b51534a68aa7beb883ace74cd => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:58.299161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:58.303696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.304732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11b90c6197540b29866669cb4bddb75', 'request_id': 'req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.408851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11b90c6197540b29866669cb4bddb75', 'request_id': 'req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.419804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11b90c6197540b29866669cb4bddb75', 'request_id': 'req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.460245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] The token cache is being invalidate because project a11b90c6197540b29866669cb4bddb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:58:58.460561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.462744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3d4ca699-7adf-49d5-8b75-cd1dbafbdd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:58:58.467629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 876/1742] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:58:58 2022] DELETE /identity/v3/projects/a11b90c6197540b29866669cb4bddb75 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:58.469156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.469677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.470062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.489521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dd3c-f8d7-44e8-8d8d-a0312f8224eb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:58.495687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:58.497310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.498118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.498713 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.500515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:58.500515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:58.502409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced032fa-91ab-441c-9825-c08bca4002bc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:58.515412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:58.518282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.523961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 867/1743] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:58.526043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25abe-cb70-4109-9c1d-b6c8699097bd None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.526549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25abe-cb70-4109-9c1d-b6c8699097bd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.527185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25abe-cb70-4109-9c1d-b6c8699097bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.533268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 877/1744] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:58.535054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:58.538256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.556638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-87d25abe-cb70-4109-9c1d-b6c8699097bd None None] MFA Rules not processed for user `a426eed4598345878445c6ba2ab913d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:58.558410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-87d25abe-cb70-4109-9c1d-b6c8699097bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.633333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 868/1745] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:58.635298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.635796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.636296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.654318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64960bc-71dd-4000-a3fb-8e4a75def6c2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:58.658377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:58.659570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.659900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.660183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.662128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.685329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:58.687444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.697941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 869/1746] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:58.698838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:58.712129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.778304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19f14a-f598-4c13-b1db-3cc96f0a6d96 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:58.784366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:58.785295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.785580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.785858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.786577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:58.791999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944b610-79fc-465b-836a-bac6098da2d7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:58.836211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:58.838036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:58.853863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 878/1747] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:58.869061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:58.873371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:58.954945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 870/1748] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:58 2022] POST /identity/v3/projects => generated 405 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:58.954945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:58.954945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:58.954945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:58.996003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:58.998296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:59.161621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 871/1749] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:59.162601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.176462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4ccd9-1195-468f-86f1-ee07024c998a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.182545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.183294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.183577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.183970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.185640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.187960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.279933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b52a4-449d-4272-baa0-1dee67eb54e0 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.304651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 872/1750] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:59 2022] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:59.304651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.336939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec834f-eda4-4afb-84d9-42b9927403fc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.352577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.353325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.353620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.353904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.354710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:58:59.356162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.357909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.375188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:59.376265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.376966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.377306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.385426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.393505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.395108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.397991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 873/1751] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:59.399014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.440925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 879/1752] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:59.441045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f715d-9706-40e7-b4d9-cb516fbe04ca admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.442469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.457203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.458547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.459072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.459500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.460424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.462359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.487517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 874/1753] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:59.496086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.512310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f588e-53bc-4018-95c4-156b0fafe22c service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.517681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ba702-3416-41b8-837b-e34b4ba93ff6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.518324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.519640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.520012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.520385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.521242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.523387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.532560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.533556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.534087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.534517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.535414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.537222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.563290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 875/1754] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:58:59.565937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.583789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30318-5f62-4085-b143-9469a5d90634 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.599103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.600447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.600815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.601128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] PATH_INFO: `/v3/projects/3b9d9f5065e4431babaa66d53ff0a935/users/2adcdfeda81d4f4591c414084b499b45/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.615164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 880/1755] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:58:59 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:59.619881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.639003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9d9f5065e4431babaa66d53ff0a935, user_id=2adcdfeda81d4f4591c414084b499b45, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.642574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9334-1d96-431a-99ab-cdaa6f77bcb4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.741882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10b0ba-39e7-4005-8047-db4a63cbf6a7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:59.747853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:59.748559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.748960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.749298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.750009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:59.752284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:59.779166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 876/1756] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:58:59 2022] PUT /identity/v3/projects/3b9d9f5065e4431babaa66d53ff0a935/users/2adcdfeda81d4f4591c414084b499b45/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:58:59.781007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:59.782545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:59.783686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:59.858381 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:59.860118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:59.891033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 881/1757] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:58:59 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:58:59.892219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:59.936542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9dd7d-5ccd-4354-994d-e5ad59ab8d04 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.024302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 877/1758] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:00.040226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.115106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.115721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.116017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.116111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:00.124658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.125583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.127717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.150797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 882/1759] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:00.151072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838401-9c19-4ba6-b9cf-03065a0c9a5d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.151920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.154820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.156112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.156400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.163243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.170239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3204-c1cf-48cb-93f2-23f42980ff37 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.180996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.182967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.188777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.189615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.189827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.190119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.190873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.196027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645bfa4-7ccf-46d4-b7a8-df14ba66659a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.206791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 878/1760] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:00.266707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.267847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 883/1761] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:00.287110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239859-23c5-4cae-ab6a-e1ddaa215502 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.304584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.305914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.307089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.307386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] PATH_INFO: `/v3/projects/ea8815f0de574710afe987d7e0bf545d/users/b691a3ad18394ab18ee2f479db549fa7/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.333618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8815f0de574710afe987d7e0bf545d, user_id=b691a3ad18394ab18ee2f479db549fa7, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.336423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.432836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 879/1762] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:00 2022] PUT /identity/v3/projects/ea8815f0de574710afe987d7e0bf545d/users/b691a3ad18394ab18ee2f479db549fa7/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:00.445790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.449255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.449902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.516620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] MFA Rules not processed for user `b691a3ad18394ab18ee2f479db549fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:00.518183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:00.573457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.576811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:00.655288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:00.707132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 884/1763] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:00.723658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.749171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7228-588d-4cb8-993e-de9ed51dee0b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.756302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.757633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.759895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.760310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] PATH_INFO: `/v3/projects/221485d8a70249c59797d4fc4e713ec1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.765958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] RBAC: Authorizing `identity:delete_project(project_id=221485d8a70249c59797d4fc4e713ec1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.769456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.826044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d892bf-36ea-4b9f-9481-e55564b9d7a1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.830456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.831332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.832073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.832073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.846009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.848584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.859872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 885/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:00.895982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.916901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dcdee-57ff-4bd1-9027-db8642bfe752 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.938630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.941665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.942518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.942808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] PATH_INFO: `/v3/users/b691a3ad18394ab18ee2f479db549fa7` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.947189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b691a3ad18394ab18ee2f479db549fa7)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.964807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221485d8a70249c59797d4fc4e713ec1', 'request_id': 'req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:00.968931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:01.077086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221485d8a70249c59797d4fc4e713ec1', 'request_id': 'req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.084081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221485d8a70249c59797d4fc4e713ec1', 'request_id': 'req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.111700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] The token cache is being invalidate because project 221485d8a70249c59797d4fc4e713ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:01.112008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.112816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.114845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 880/1765] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:00 2022] DELETE /identity/v3/projects/221485d8a70249c59797d4fc4e713ec1 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:01.118737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:01.121283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:01.231769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f93e8-667e-4dfe-92bd-cb0b033a776c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:01.238051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:01.239145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:01.239436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:01.239718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] PATH_INFO: `/v3/users/f906038cd0784c8cab49578d46642284` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:01.241048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f906038cd0784c8cab49578d46642284)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:01.244061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:01.298891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b691a3ad18394ab18ee2f479db549fa7'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.317993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b691a3ad18394ab18ee2f479db549fa7'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.322371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b691a3ad18394ab18ee2f479db549fa7'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.322594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b691a3ad18394ab18ee2f479db549fa7'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.475934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-be9bf2ed-8659-4a2a-8be1-da6ac8f1c870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b691a3ad18394ab18ee2f479db549fa7'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.515469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 886/1766] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:00 2022] DELETE /identity/v3/users/b691a3ad18394ab18ee2f479db549fa7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:01.520235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432240d-84a7-4b42-b496-df13a73cd935 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:01.520539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432240d-84a7-4b42-b496-df13a73cd935 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:01.520886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432240d-84a7-4b42-b496-df13a73cd935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:01.528583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:01.546383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f906038cd0784c8cab49578d46642284'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.547079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f906038cd0784c8cab49578d46642284'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.548409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f906038cd0784c8cab49578d46642284'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.549061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6432240d-84a7-4b42-b496-df13a73cd935 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:01.550957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6432240d-84a7-4b42-b496-df13a73cd935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:01.570102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f906038cd0784c8cab49578d46642284'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.645331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 887/1767] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:01.647357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecc7e-7dac-4d39-bc9c-87647cb2e764 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:01.647656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecc7e-7dac-4d39-bc9c-87647cb2e764 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:01.648039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ecc7e-7dac-4d39-bc9c-87647cb2e764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:01.701449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f906038cd0784c8cab49578d46642284'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:01.761938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 881/1768] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:01 2022] DELETE /identity/v3/users/f906038cd0784c8cab49578d46642284 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:01.766452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:01.766452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:01.766845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-609ecc7e-7dac-4d39-bc9c-87647cb2e764 None None] MFA Rules not processed for user `faa03e9023bb4b7a84cee7fa85bcf1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:01.772517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-609ecc7e-7dac-4d39-bc9c-87647cb2e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:01.877240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e56d-8afa-4a89-9020-4370ace2db3d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:01.881577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:01.882324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:01.882617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:01.882896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:02.007155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:02.013576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 888/1769] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:02.017327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:02.038140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 882/1770] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:02.155111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:02.156384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:02.156811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:02.212931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:02.220632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:02.404875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 889/1771] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:02.741303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:02.797672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:02.799187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:02.965466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bbe-d896-41b8-8248-28f4de185b32 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:02.976533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:02.977285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:02.977570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:02.977841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:02.999311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:03.000154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d9a78-24c1-4433-8c9b-203f7b598568 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:03.023242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 883/1772] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 12:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:59:03.076393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:03.238121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:03.239931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:03.285566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e0e15-11df-4e3f-b4eb-b7ae490606a6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:03.291482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:03.292789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:03.293991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:03.294530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] PATH_INFO: `/v3/projects/622497f2d1a3403893216d176bbe430f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:03.301670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=622497f2d1a3403893216d176bbe430f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:03.304209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:03.541413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622497f2d1a3403893216d176bbe430f', 'request_id': 'req-e786e2b6-5b28-4704-ac98-379e876e3b1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:03.623679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:03.624333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:03.624974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:03.643624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622497f2d1a3403893216d176bbe430f', 'request_id': 'req-e786e2b6-5b28-4704-ac98-379e876e3b1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:03.655668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622497f2d1a3403893216d176bbe430f', 'request_id': 'req-e786e2b6-5b28-4704-ac98-379e876e3b1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:03.691501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] The token cache is being invalidate because project 622497f2d1a3403893216d176bbe430f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:03.691811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:03.693907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e786e2b6-5b28-4704-ac98-379e876e3b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:03.699832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 890/1773] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:03 2022] DELETE /identity/v3/projects/622497f2d1a3403893216d176bbe430f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:03.707436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd365f-94e7-4e4b-8eb2-1a4668cd89c1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:03.709427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd365f-94e7-4e4b-8eb2-1a4668cd89c1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:03.709427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd365f-94e7-4e4b-8eb2-1a4668cd89c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:03.734812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] MFA Rules not processed for user `2adcdfeda81d4f4591c414084b499b45`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:03.736359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:03.760989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-defd365f-94e7-4e4b-8eb2-1a4668cd89c1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:03.762642 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-defd365f-94e7-4e4b-8eb2-1a4668cd89c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:03.878686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 884/1774] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:03.888813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:03.888813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:03.986676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:03.997736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 891/1775] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:03.999389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:03.999690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:03.999969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.021954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594c5ef-04b7-49d6-8aec-3b7faa926074 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.033625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.036079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.036628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.037264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.038269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.040511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:04.085141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:04.086436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:04.122606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 892/1776] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:04.123609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:04.151800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e61f-a619-41dc-9a2b-173a76101496 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.160444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 885/1777] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:03 2022] POST /identity/v3/projects => generated 405 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:04.162228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:04.162563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.163279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.163544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.163871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.164662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:04.169857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.171682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:04.207733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 893/1778] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:04.210590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:04.241902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7238-61f0-4bed-8f37-71689924ceaa admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.417474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.422417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.425105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.425580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.426457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.432079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:04.467372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2c1eb-69d6-4e98-b290-af27d251ead6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.475925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.477387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.478311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.478711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.481135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.485073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:04.542687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 894/1779] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:04 2022] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:04.544536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:04.546454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:04.592399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 886/1780] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:04 2022] POST /identity/v3/users => generated 309 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:04.594960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:04.646506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea2d-bb6e-419e-8930-b929493e3e3c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.678523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88feb-3a8d-4d28-9cf6-d3ba753866ba admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:04.716805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.717948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.718244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.718530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] PATH_INFO: `/v3/projects/ea8815f0de574710afe987d7e0bf545d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.737417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8815f0de574710afe987d7e0bf545d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.737417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:04.815682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:04.862083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:04.862795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:04.863593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:04.863893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:04.864604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:04.872877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:05.264403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8815f0de574710afe987d7e0bf545d', 'request_id': 'req-cc50c96f-e17f-4e8a-afe7-85e189d2767a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:05.310846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 887/1781] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:04 2022] POST /identity/v3/users => generated 293 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:05.310846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.322118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8815f0de574710afe987d7e0bf545d', 'request_id': 'req-cc50c96f-e17f-4e8a-afe7-85e189d2767a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:05.330002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8815f0de574710afe987d7e0bf545d', 'request_id': 'req-cc50c96f-e17f-4e8a-afe7-85e189d2767a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:05.331681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bbb2-1089-41b1-90e4-68703732b0a4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.352081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] The token cache is being invalidate because project ea8815f0de574710afe987d7e0bf545d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:05.352191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:05.353004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:05.358428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 895/1782] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:04 2022] DELETE /identity/v3/projects/ea8815f0de574710afe987d7e0bf545d => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:05.359214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.367927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:05.511951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:05.512923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.513426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.513891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.514717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:05.519506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f0bf5-8081-4e30-81e5-4dfcb74208d8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:05.547755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 888/1783] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:05.549651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.549953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.550335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.559288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c96f-e17f-4e8a-afe7-85e189d2767a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.583109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:05.583844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.584193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.584538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.585424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:05.587897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:05.594162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:05.598005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:05.621250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 896/1784] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:05.621250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.621795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:05.628974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 889/1785] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:05.630211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.656239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102bbea-8152-478f-bdb6-897cef706fc4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.659951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f87f7-e637-4661-82ce-ba998ccd17ce admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.670479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:05.671699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.672130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.673468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] PATH_INFO: `/v3/projects/b8dd83723d3b447d98e7f394826364c0/users/fa7192999ab948c28b5cbeb2d583d69b/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.680042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:05.680946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.682025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.682025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.682229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:05.689220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425645f-108e-41be-992a-155ee88bea1f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:05.709389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dd83723d3b447d98e7f394826364c0, user_id=fa7192999ab948c28b5cbeb2d583d69b, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:05.715785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:05.737871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 890/1786] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:05.749279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:05.750132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:05.750923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:05.757975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:05.792274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:05.792274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:05.818936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 891/1787] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:05.826349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.827129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 897/1788] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:05 2022] PUT /identity/v3/projects/b8dd83723d3b447d98e7f394826364c0/users/fa7192999ab948c28b5cbeb2d583d69b/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:05.827129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:05.853670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e2c92-10ab-429d-bd27-d02e44588bbc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.984366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906998e-0c01-4c27-b876-c4bfbe952ba0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:05.998646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.000301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.001345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.001987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.003009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:06.003533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.006780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.038370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 898/1789] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:06.038370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:06.067087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.067087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.067087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.067087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] PATH_INFO: `/v3/projects/19c04f41e0864d9f93066a8fb67591bf/users/26f47f03f50e48c08ae953f65e6d7d57/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.068801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f9f4-a861-411f-bd21-4bdd5ccff6b4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:06.074581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.075762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.076141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.076515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.077093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.078958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.095410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:06.109521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c04f41e0864d9f93066a8fb67591bf, user_id=26f47f03f50e48c08ae953f65e6d7d57, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.124154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.125213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 899/1790] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:06.127210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:06.150850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c08d8-5bec-419b-8c39-e359246311c0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:06.159105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.159105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.159105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.159105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.159525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.162160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913d9f-85ac-4c2b-9103-e1445f82c738 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.225838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 892/1791] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:05 2022] PUT /identity/v3/projects/19c04f41e0864d9f93066a8fb67591bf/users/26f47f03f50e48c08ae953f65e6d7d57/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:06.225838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:06.316377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 900/1792] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:06 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:06.318849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c76-ab04-4fbc-9430-2b362c30b554 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.319552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c76-ab04-4fbc-9430-2b362c30b554 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.321644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41c76-ab04-4fbc-9430-2b362c30b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.415168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-eab41c76-ab04-4fbc-9430-2b362c30b554 None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:06.417683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-eab41c76-ab04-4fbc-9430-2b362c30b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:06.467046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700c6a-72ac-4762-ac3c-55faa37de1ae admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:06.548827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 901/1793] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 5 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:06.550760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.551255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.551904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.594000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] MFA Rules not processed for user `26f47f03f50e48c08ae953f65e6d7d57`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:06.595882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:06.630114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.630114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.630114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.630114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] PATH_INFO: `/v3/projects/b8dd83723d3b447d98e7f394826364c0/users/fa7192999ab948c28b5cbeb2d583d69b/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.635979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dd83723d3b447d98e7f394826364c0, user_id=fa7192999ab948c28b5cbeb2d583d69b, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.640856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.669063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 893/1794] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:06 2022] PUT /identity/v3/projects/b8dd83723d3b447d98e7f394826364c0/users/fa7192999ab948c28b5cbeb2d583d69b/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:06.674173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:06.770761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 902/1795] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:06.774371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:06.774371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:06.843641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b563af-eae6-48af-9330-b47ffa7ee898 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:06.944177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee1ec-9d0c-416b-b730-8f55e26f84e8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:06.959431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.960194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.960743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.961093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:06.961980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:06.964517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:06.995279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:06.996002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:06.996450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:06.996768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.023446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.026652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.052268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 903/1796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:07.053439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.075660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb464-7915-45ac-8f27-f87a74043014 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.076614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.077439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.077863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.078208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.078962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.081152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.134604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 894/1797] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:06 2022] POST /identity/v3/users => generated 292 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:07.149967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.185236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f957e6c-792c-4724-ad1f-21107e4dbf4e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.197027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:07.197841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.204482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.207461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.207461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.207461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.207461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.242614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 895/1798] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:07.242913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 904/1799] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:07 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:07.246237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.263851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:07.266466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.298689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07619-3453-4adf-9c02-96513e4e1601 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.496018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407998-2759-4311-b09a-2f4c5fedd108 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.530573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.530573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.530573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.530573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.531021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.531112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.531112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.531112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.531112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.531963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.533748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.541339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.588665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 896/1800] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:07.601775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.643045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a215a2-02bb-49c5-8c64-8b02c95cedcc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.674339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.676243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.676745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.681049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] PATH_INFO: `/v3/projects/c081dd86accf43e8a5a086390e1ff51c/users/bd1e02de662a4a81952642010f9fe295/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.715323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 905/1801] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:07 2022] POST /identity/v3/users => generated 293 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:07.722938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.747654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c081dd86accf43e8a5a086390e1ff51c, user_id=bd1e02de662a4a81952642010f9fe295, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.778647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0ba7-5656-4bbf-819e-346732905e3a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.795460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c189b48-d9ce-4f88-a5e4-079d07fa7890 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.813502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.814225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.814519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.815318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.815532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.817202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.862072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 906/1803] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:07.865918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.873733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 897/1803] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:07 2022] PUT /identity/v3/projects/c081dd86accf43e8a5a086390e1ff51c/users/bd1e02de662a4a81952642010f9fe295/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:07.878484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.880879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.880879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.901513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521f5a-bd6f-4b8c-9fc0-38ad98366452 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.938916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] MFA Rules not processed for user `bd1e02de662a4a81952642010f9fe295`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:07.940440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:08.076593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:08.080044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 898/1804] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:08.082095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.082461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.082756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.095211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:08.096645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:08.096882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:08.100438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:08.150430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 907/1805] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:08.158148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:08.192098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c718-23f2-46a6-b34d-315085f28817 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:08.200125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:08.201616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.201909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.202279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] PATH_INFO: `/v3/projects/7da43c7a0d8a4a9cb49b7ef6a9d8798f/users/46cc054c4bdb41eebfc9f6f2e9f2304e/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.230831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e90bc-6517-4bd6-b76e-e3c3ca0a6b6a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:08.239505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:08.240064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.240416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.240777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.246630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da43c7a0d8a4a9cb49b7ef6a9d8798f, user_id=46cc054c4bdb41eebfc9f6f2e9f2304e, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:08.252707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:08.276721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:08.279477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65854-f8c6-4fc3-9285-79c9dfcfd709 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:08.293612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 899/1806] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:08.369240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:08.409137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 908/1807] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:08 2022] PUT /identity/v3/projects/7da43c7a0d8a4a9cb49b7ef6a9d8798f/users/46cc054c4bdb41eebfc9f6f2e9f2304e/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:08.422920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.423295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.423715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.465401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:08.478179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] MFA Rules not processed for user `46cc054c4bdb41eebfc9f6f2e9f2304e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:08.481036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:08.616215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 900/1808] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:08.620120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:08.864307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a635-b8b9-44ba-a80e-923d53efc5cd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:08.874614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:08.876599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.876599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.876599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.890986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:08.897185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.057903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 909/1809] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:08 2022] POST /identity/v3/projects => generated 385 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:09.062469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:09.081927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c137ed-6892-4ca3-8127-62350e06ffa9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:09.195518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:09.201797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.201797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.202265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.207320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:09.209871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.353922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 901/1810] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:09 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:09.357873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:09.370188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7372-c2bd-4a78-b7e2-dc608478aa08 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:09.376382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:09.377406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.377569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.377748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.378716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:09.380091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.400538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 910/1811] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:09.404373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:09.421887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e025c5-9951-489c-bf90-ddd6ba69ece0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:09.453436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:09.457204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.458151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.458443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] PATH_INFO: `/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b/users/57e5ee1cc95040ae91ad8774d97fc390/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.504596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5180bb0ebdd495db8971efc7ecafd8b, user_id=57e5ee1cc95040ae91ad8774d97fc390, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:09.509754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.596407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 902/1812] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:09 2022] PUT /identity/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b/users/57e5ee1cc95040ae91ad8774d97fc390/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:09.597840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:09.619731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba8bf-32fd-4328-91ca-e67fb4d9310f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:09.710176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:09.711593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.712089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.712563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.713592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:09.716456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167083-5bd3-4874-b1cb-6edb4084f56b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.732037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 911/1813] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:09.733835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:09.751626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0fef-dad6-4d55-8286-538bb11bb861 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:09.760581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:09.765038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.765767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.766263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] PATH_INFO: `/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b/users/57e5ee1cc95040ae91ad8774d97fc390/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.802312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5180bb0ebdd495db8971efc7ecafd8b, user_id=57e5ee1cc95040ae91ad8774d97fc390, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:09.828432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:09.867045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 903/1814] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:09 2022] PUT /identity/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b/users/57e5ee1cc95040ae91ad8774d97fc390/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:09.878199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2359c2-c7cd-4706-a8cf-515731440832 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:09.878506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2359c2-c7cd-4706-a8cf-515731440832 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:09.878783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2359c2-c7cd-4706-a8cf-515731440832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:09.955020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cf2359c2-c7cd-4706-a8cf-515731440832 None None] MFA Rules not processed for user `57e5ee1cc95040ae91ad8774d97fc390`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:09.961799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cf2359c2-c7cd-4706-a8cf-515731440832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:10.159730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 912/1815] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:10.176221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:10.191345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:10.346440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa9b46-c390-44c1-8ed0-af942fb79558 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:10.347400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:10.348207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:10.348590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:10.348986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:10.369901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:10.542652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:10.547286 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d07c3-7569-4c91-b945-c9b014e480d1 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:10.569393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 904/1816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:10.655040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7968a-8c4d-45f1-be03-c00c2ede1366 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:10.657178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7968a-8c4d-45f1-be03-c00c2ede1366 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:10.657178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7968a-8c4d-45f1-be03-c00c2ede1366 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:10.657607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 913/1817] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:10.707695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:10.708275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:10.709002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:10.815754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:10.826704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:10.977006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d3a5-66b7-4ccf-a54e-e92a0c2ce3a2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:10.978307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d3a5-66b7-4ccf-a54e-e92a0c2ce3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:10.978790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d3a5-66b7-4ccf-a54e-e92a0c2ce3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:11.083167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b378d3a5-66b7-4ccf-a54e-e92a0c2ce3a2 None None] MFA Rules not processed for user `fa7192999ab948c28b5cbeb2d583d69b`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:11.086103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b378d3a5-66b7-4ccf-a54e-e92a0c2ce3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:11.187300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 905/1818] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:11.209509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:11.211197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:11.215903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 914/1819] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:11.250730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74383dcd-9dfa-4039-bfa4-50f695220707 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:11.278159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:11.279032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:11.279320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:11.279599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:11.296625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:11.306483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feeff7-ed13-4823-b165-264bca72c8d4 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:11.339842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 906/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:11.831678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:11.881692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb938d-ea03-4267-ba90-00b9ef353bbc None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:11.882055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb938d-ea03-4267-ba90-00b9ef353bbc None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:11.882423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb938d-ea03-4267-ba90-00b9ef353bbc None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:11.889478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 915/1821] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:59:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:11.921153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90000-b681-4e6e-9561-25ea228dc1a8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:11.921511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90000-b681-4e6e-9561-25ea228dc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:11.927211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90000-b681-4e6e-9561-25ea228dc1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:11.960917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2ad90000-b681-4e6e-9561-25ea228dc1a8 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:11.962289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2ad90000-b681-4e6e-9561-25ea228dc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:11.988502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 907/1822] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:12.162721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:12.900214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb938d-ea03-4267-ba90-00b9ef353bbc None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:12.926742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb938d-ea03-4267-ba90-00b9ef353bbc None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:12.935240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:12.936290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:12.937121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:12.937580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:12.951482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:12.953660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e049-95a9-410c-b411-ce18a5b72477 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:12.957093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:12.973287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 916/1823] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:13.327180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:13.632841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:13.633305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:13.633747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:13.636454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 908/1824] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:13.761584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:13.768784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:13.768784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:13.788392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:13.793849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:13.967724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 917/1825] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:13.986892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:13.988861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:14.056464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35f7eb-f67a-49f3-a736-d2721d2f9859 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:14.081081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:14.081756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:14.082039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:14.082320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:14.099271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:14.101088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd94ce-c1c1-4edd-856a-458d7d301dcc service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:14.124522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 909/1826] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:14.257452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:14.281008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363c2d7-96a6-499c-9a35-f11eebf9f779 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:14.286153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:14.287243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:14.287742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:14.288168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:14.373462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:14.387892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94297-705d-4765-a35d-84c391a16abe service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:14.390185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:14.403836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 918/1827] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:14.636933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:15.713705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1588-9faf-4dad-bc5a-db66ceaa9f98 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:15.714285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1588-9faf-4dad-bc5a-db66ceaa9f98 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:15.714444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1588-9faf-4dad-bc5a-db66ceaa9f98 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:15.716720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 910/1828] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:15.724994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:15.725537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:15.727181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:15.782069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] MFA Rules not processed for user `fc48d9e605e242d19446c497bde122f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:15.783376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:15.811087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 919/1829] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:59:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:15.909650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e1588-9faf-4dad-bc5a-db66ceaa9f98 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:15.927610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e1588-9faf-4dad-bc5a-db66ceaa9f98 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:15.940169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:15.941546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:15.942210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:15.942658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:15.955444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:15.958465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:15.977442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 911/1830] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:16.088827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:16.117013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:16.230101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552616-b058-4839-855c-69dba0f4d1c6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:16.240924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:16.242734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:16.243209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:16.243799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] PATH_INFO: `/v3/users/2adcdfeda81d4f4591c414084b499b45` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:16.247783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adcdfeda81d4f4591c414084b499b45)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:16.249939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:16.345241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:16.483431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adcdfeda81d4f4591c414084b499b45'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:16.500331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adcdfeda81d4f4591c414084b499b45'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:16.506325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adcdfeda81d4f4591c414084b499b45'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:16.508850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adcdfeda81d4f4591c414084b499b45'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:16.635522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adcdfeda81d4f4591c414084b499b45'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:16.674070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 920/1831] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:16 2022] DELETE /identity/v3/users/2adcdfeda81d4f4591c414084b499b45 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:16.736593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:16.757439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503298f-4dd1-4531-ae8a-d9b791af0198 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:16.866430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:16.868209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:16.870115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:16.871484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:16.876444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:17.057802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:17.060367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:17.089391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 912/1832] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:17.537432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:17.540638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:17.616854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f275-32a5-489a-adfe-f52607dfcd97 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:17.622644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:17.623556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:17.623840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:17.624115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] PATH_INFO: `/v3/projects/3b9d9f5065e4431babaa66d53ff0a935` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:17.625472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9d9f5065e4431babaa66d53ff0a935)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:17.627459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:17.630015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:17.762835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9d9f5065e4431babaa66d53ff0a935', 'request_id': 'req-281d7aed-a627-41d4-ae1e-9c757506e2c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:17.893411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9d9f5065e4431babaa66d53ff0a935', 'request_id': 'req-281d7aed-a627-41d4-ae1e-9c757506e2c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:17.893753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:17.900054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9d9f5065e4431babaa66d53ff0a935', 'request_id': 'req-281d7aed-a627-41d4-ae1e-9c757506e2c5'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:17.910675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] The token cache is being invalidate because project 3b9d9f5065e4431babaa66d53ff0a935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:17.910963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:17.911622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:17.913233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 921/1833] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:17 2022] DELETE /identity/v3/projects/3b9d9f5065e4431babaa66d53ff0a935 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:17.918038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:17.936159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd2e5-98f3-443b-898c-9871eb95e132 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:17.994700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:17.996208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:17.996512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:17.996902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] PATH_INFO: `/v3/users/fa7192999ab948c28b5cbeb2d583d69b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:17.998133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7192999ab948c28b5cbeb2d583d69b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:18.000066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:18.166637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7192999ab948c28b5cbeb2d583d69b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.167290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7192999ab948c28b5cbeb2d583d69b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.168531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7192999ab948c28b5cbeb2d583d69b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.175958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7192999ab948c28b5cbeb2d583d69b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.253601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7192999ab948c28b5cbeb2d583d69b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.282150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 913/1834] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:17 2022] DELETE /identity/v3/users/fa7192999ab948c28b5cbeb2d583d69b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:18.546042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:18.547538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:18.574306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d7aed-a627-41d4-ae1e-9c757506e2c5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:18.612425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:18.614085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:18.665676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:18.666807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:18.667210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:18.667547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] PATH_INFO: `/v3/users/789f8a19a737437283d4b286ee9e47bb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:18.671492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] RBAC: Authorizing `identity:delete_user(user_id=789f8a19a737437283d4b286ee9e47bb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:18.674090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:18.752707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9654ae-3918-4180-ab8f-4d8420b98bba admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:18.762190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:18.763090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:18.763380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:18.763689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] PATH_INFO: `/v3/projects/b8dd83723d3b447d98e7f394826364c0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:18.764944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8dd83723d3b447d98e7f394826364c0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:18.766937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:18.984934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789f8a19a737437283d4b286ee9e47bb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:18.989668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dd83723d3b447d98e7f394826364c0', 'request_id': 'req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.003154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789f8a19a737437283d4b286ee9e47bb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.004992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789f8a19a737437283d4b286ee9e47bb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.006208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789f8a19a737437283d4b286ee9e47bb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.139258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dd83723d3b447d98e7f394826364c0', 'request_id': 'req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.147260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dd83723d3b447d98e7f394826364c0', 'request_id': 'req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.158270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] The token cache is being invalidate because project b8dd83723d3b447d98e7f394826364c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:19.158565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.159292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4a966b52-4407-4dcb-8dbf-a2f02c9b9fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.160950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 914/1835] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:18 2022] DELETE /identity/v3/projects/b8dd83723d3b447d98e7f394826364c0 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:19.165665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371540-0fe6-4568-8c65-509f7da1292f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.166045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371540-0fe6-4568-8c65-509f7da1292f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.166329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371540-0fe6-4568-8c65-509f7da1292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.187436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c3371540-0fe6-4568-8c65-509f7da1292f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:19.188689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c3371540-0fe6-4568-8c65-509f7da1292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:19.207833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d6728d77-0fef-4290-b03d-d167a7ee109f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789f8a19a737437283d4b286ee9e47bb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:19.227395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 922/1836] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:18 2022] DELETE /identity/v3/users/789f8a19a737437283d4b286ee9e47bb => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:19.232039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.232387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.234833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.250765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:19.251057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 915/1837] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:19.252152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:19.258584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.258864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.259143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.278721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:19.279943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:19.320784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 923/1838] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:19.332446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.334087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:19.405613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cd6e7-832b-4a8e-b747-0dc312f04b01 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:19.414329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:19.415321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.415783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.416224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.428002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:19.429740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:19.461130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 924/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:19.487311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.499557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 916/1840] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:19.500162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cd6d-3df9-49fb-b8e8-3c63cca188ae service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:19.505379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:19.506168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.506606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.506961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.507867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:19.508720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:19.510477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:19.525124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 925/1841] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:19.529859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.544492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19f9c7-5bc9-4af0-84d7-7440cd61e117 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:19.544944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:19.545617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.545900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.546175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.546875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:19.548801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:19.656032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 917/1842] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:19 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:19.660280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.671444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdeb7e-73cb-4844-8f1a-827e7936a236 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:19.735160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:19.736472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.736886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.737240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.738027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:19.740027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:19.937113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 926/1843] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:19 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:19.938176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.949649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c593b-8f61-4a77-a980-d1c08271f621 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:19.955954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:19.956758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:19.957250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:19.957602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:19.958404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:19.960325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:19.976271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:19.976808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 918/1844] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:19.997341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb46d-9519-493d-b4f7-e720258b723d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.003487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.004132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.004973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.005066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.006047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.011911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.024379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 927/1845] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:20.029287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.040499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f113f-b456-47de-9c1b-45389a131494 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.046255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.047370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.047653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.047925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] PATH_INFO: `/v3/projects/36c1910b47f845d48b61915d787a3e99/users/52bbe241d5434a5fbd464182b1c98bb3/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.063808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:20.065969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c1910b47f845d48b61915d787a3e99, user_id=52bbe241d5434a5fbd464182b1c98bb3, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.068604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.076652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.078375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.091904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97ff7-67a3-4722-9aaa-7f2286aa0965 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.096275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.097219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.097567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.097849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] PATH_INFO: `/v3/users/bd1e02de662a4a81952642010f9fe295` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.099069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1e02de662a4a81952642010f9fe295)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.101022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.157299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 919/1846] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:20 2022] PUT /identity/v3/projects/36c1910b47f845d48b61915d787a3e99/users/52bbe241d5434a5fbd464182b1c98bb3/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:20.158490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.160101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.232838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e2845-6aa8-4a56-ac4b-e25e139eb0ea admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.237493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.238389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.238670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.238943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] PATH_INFO: `/v3/projects/d37c051f103a4f0fa33ea543d11b763e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.240148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37c051f103a4f0fa33ea543d11b763e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.242080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.278792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1e02de662a4a81952642010f9fe295'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.285497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1e02de662a4a81952642010f9fe295'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.286346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1e02de662a4a81952642010f9fe295'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.287147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1e02de662a4a81952642010f9fe295'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.350228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37c051f103a4f0fa33ea543d11b763e', 'request_id': 'req-8d4ba594-f888-4842-97a3-35c191f1b2f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.356020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-803dbc04-5e40-411e-996b-c38a799efa40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1e02de662a4a81952642010f9fe295'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.374080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 928/1847] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:20 2022] DELETE /identity/v3/users/bd1e02de662a4a81952642010f9fe295 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:20.375375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.375665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.375949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.403689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] MFA Rules not processed for user `52bbe241d5434a5fbd464182b1c98bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:20.404944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.419516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37c051f103a4f0fa33ea543d11b763e', 'request_id': 'req-8d4ba594-f888-4842-97a3-35c191f1b2f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.426260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37c051f103a4f0fa33ea543d11b763e', 'request_id': 'req-8d4ba594-f888-4842-97a3-35c191f1b2f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.437709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] The token cache is being invalidate because project d37c051f103a4f0fa33ea543d11b763e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:20.438000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.438678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d4ba594-f888-4842-97a3-35c191f1b2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.440315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 920/1848] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:20 2022] DELETE /identity/v3/projects/d37c051f103a4f0fa33ea543d11b763e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:20.441668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.441958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.442319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.459981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:20.461372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.470263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 929/1849] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:20.473670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.481255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.520124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 921/1850] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:20.521074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.522418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.535521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8bb54-efde-4d7b-a624-5cc481edab8e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.540327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.541079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.541363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.541642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.543067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.544931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.547850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264378-3272-4881-a2e6-ede175ca60a6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.552957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.553852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.554183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.554451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] PATH_INFO: `/v3/users/762ebc2ec2ee4abaa4146ececd9fed85` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.555846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=762ebc2ec2ee4abaa4146ececd9fed85)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.557783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.661623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 922/1851] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:20 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:20.662410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.664073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.720684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12181a12-71c2-47be-bf5e-ebe6afed5523 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.724371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.725048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.725335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.725612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.728183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:20.788176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.789767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.802146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 923/1852] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:20.802146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.809815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762ebc2ec2ee4abaa4146ececd9fed85'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.813607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843bd31-cf8c-4c2a-9e59-5d0afaba191b service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.815781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.816533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.816922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.817274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.818045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.820037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.827527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762ebc2ec2ee4abaa4146ececd9fed85'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.828717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762ebc2ec2ee4abaa4146ececd9fed85'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.828917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762ebc2ec2ee4abaa4146ececd9fed85'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.896492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 924/1853] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:20 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:20.897605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.899343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.912418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4b8b-c73b-435f-aef4-42a0944b3f1e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:20.915425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762ebc2ec2ee4abaa4146ececd9fed85'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:20.916653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:20.920071 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:20.920797 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.921088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.921372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.922117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:20.923736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:20.937166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 925/1854] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:20.938276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:20.941130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 930/1855] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:20 2022] DELETE /identity/v3/users/762ebc2ec2ee4abaa4146ececd9fed85 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:20.949916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1d47-970c-48a2-a6c3-75b7f38737c3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.025436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.026825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.027508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.027603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] PATH_INFO: `/v3/projects/d89b6cf899dc42059b469d6e83dbe261/users/2439ba596d8e44218c31a45badc2d9ae/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.046858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89b6cf899dc42059b469d6e83dbe261, user_id=2439ba596d8e44218c31a45badc2d9ae, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.049674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.135360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 926/1856] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:20 2022] PUT /identity/v3/projects/d89b6cf899dc42059b469d6e83dbe261/users/2439ba596d8e44218c31a45badc2d9ae/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:21.140178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.150664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbf2-d192-45b5-b72b-78cb6be5a6fe admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.229605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.231013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.231013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.231162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.231834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.233532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a9e04-1910-453b-8af9-28c2d342847e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.250161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.251201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 931/1857] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:21.267109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbbcf-e972-4d43-b12b-b31fdba56f22 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.273001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.274031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.274454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.274838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] PATH_INFO: `/v3/projects/d89b6cf899dc42059b469d6e83dbe261/users/2439ba596d8e44218c31a45badc2d9ae/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.277980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89b6cf899dc42059b469d6e83dbe261, user_id=2439ba596d8e44218c31a45badc2d9ae, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.281268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.294760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 927/1858] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:21 2022] PUT /identity/v3/projects/d89b6cf899dc42059b469d6e83dbe261/users/2439ba596d8e44218c31a45badc2d9ae/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:21.305540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.306113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.306113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.335851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] MFA Rules not processed for user `2439ba596d8e44218c31a45badc2d9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:21.337115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.422113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 932/1859] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:21.430337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.432125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.495389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.497072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.512131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b94a-ed6a-4363-bd20-ad8b6c511756 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.517545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.518481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.518811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.519136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.533164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.534896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.548010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 928/1860] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:21.549293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.550678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.570985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d865d8f-e3c9-4d45-80e9-8186c9970812 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.590293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.591320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.591613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.591903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] PATH_INFO: `/v3/projects/c522e81f51c6446dacc96f0d30254f14` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.596152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c522e81f51c6446dacc96f0d30254f14)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.598135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.643617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77fc1-0c42-4712-a147-0b14b570b342 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.646575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.647451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.647735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.648011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] PATH_INFO: `/v3/projects/c081dd86accf43e8a5a086390e1ff51c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.649344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c081dd86accf43e8a5a086390e1ff51c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.651240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.701271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c522e81f51c6446dacc96f0d30254f14', 'request_id': 'req-9f57e7da-0441-4b28-88ba-e24494e4f12b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.825439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c081dd86accf43e8a5a086390e1ff51c', 'request_id': 'req-8cfcddba-53b1-434f-a00a-a469d2246b84'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.842988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c522e81f51c6446dacc96f0d30254f14', 'request_id': 'req-9f57e7da-0441-4b28-88ba-e24494e4f12b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.850496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c522e81f51c6446dacc96f0d30254f14', 'request_id': 'req-9f57e7da-0441-4b28-88ba-e24494e4f12b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.861520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] The token cache is being invalidate because project c522e81f51c6446dacc96f0d30254f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:21.861958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.862647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.864222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 933/1861] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:21 2022] DELETE /identity/v3/projects/c522e81f51c6446dacc96f0d30254f14 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:21.865202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.866446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.923425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57e7da-0441-4b28-88ba-e24494e4f12b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.951023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c081dd86accf43e8a5a086390e1ff51c', 'request_id': 'req-8cfcddba-53b1-434f-a00a-a469d2246b84'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.958132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c081dd86accf43e8a5a086390e1ff51c', 'request_id': 'req-8cfcddba-53b1-434f-a00a-a469d2246b84'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.968758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] The token cache is being invalidate because project c081dd86accf43e8a5a086390e1ff51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:21.969055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.969726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8cfcddba-53b1-434f-a00a-a469d2246b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:21.971314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 929/1862] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:21 2022] DELETE /identity/v3/projects/c081dd86accf43e8a5a086390e1ff51c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:21.972302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.972553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c1132-f517-4410-877f-44edf7462286 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.972882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c1132-f517-4410-877f-44edf7462286 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.972984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.973163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c1132-f517-4410-877f-44edf7462286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.973261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.973523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.976451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.993722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1b6c1132-f517-4410-877f-44edf7462286 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:21.994985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1b6c1132-f517-4410-877f-44edf7462286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:22.037445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.038888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7522-13d5-4daa-bba2-3c2f8fef29c0 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.047917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 934/1863] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:22.049291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e18b-bb44-415f-b0fc-1416f44aa893 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.049590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e18b-bb44-415f-b0fc-1416f44aa893 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.049869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e18b-bb44-415f-b0fc-1416f44aa893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.064965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 930/1864] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:22.069315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b375e18b-bb44-415f-b0fc-1416f44aa893 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:22.070661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b375e18b-bb44-415f-b0fc-1416f44aa893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:22.073416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.073711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.074016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.096857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 935/1865] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:22.104110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.104240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:22.104414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.104701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.106280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:22.116544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 931/1866] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:22.123822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.129916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:22.140588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:22.143244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:22.146939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93e8b9-d2ec-46ba-9dff-049265c2b30b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.157352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.158042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.158335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.158593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.159402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:22.159713 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.161632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.170482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:22.170568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 936/1867] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:22.174032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.182906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 932/1868] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:22.186339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0914-7770-4714-a1d7-36e9eac47398 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.190928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.195304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.198937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.198937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.198937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.198937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:22.198937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.201828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.217469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462bb9d-8021-4064-8a8e-cd04eaba8fbe admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.225046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 937/1869] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:22.229357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.232455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.233356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.234082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.234439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.235226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.238047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.247878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308acc9-1490-4511-be20-14c968b12791 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.254929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.255867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.256226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.256765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.257429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.259457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.320717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 933/1870] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:22.323803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.349251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 938/1871] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:22.350326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:22.473624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c9471-d362-4213-b070-3d8962ce359e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.474150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d90b-f1fa-4bb2-8a0a-d512162a0499 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:22.474538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.474538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.474538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.474538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.475136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:22.475287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.475413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:22.475413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:22.475413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:22.475413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:22.475884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:22.476008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.665431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 939/1872] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/users => generated 288 bytes in 1315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:23.666935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 934/1873] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:22 2022] POST /identity/v3/users => generated 284 bytes in 1343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:23.669713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.672976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.688593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e58de-c5d5-4754-970a-9aed851ef976 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.696247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea907a4-a8ac-45ca-a106-041a6516eb02 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.696395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.696395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.696395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.697536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.698226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.699933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.700152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.700994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.701375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.701751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.702595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.704283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.713791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 940/1874] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:23.715577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.722600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 935/1875] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:23.724390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.726333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf7bc5-3073-4f4c-aac9-d53128d66da5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.731758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.732483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.732803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.733210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.733961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.735570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b47ad4-5cd0-4b3b-839a-bf1258b27c6a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.735702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.740404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.741308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.741540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.741885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.743244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.744625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.750124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 941/1876] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:23.760039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 936/1877] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:23.760226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.760969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:23.771153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466521-3710-4ff4-b67a-63c09f9971b4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.771993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc0e87-ee0e-4992-911f-69f40fa85829 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:23.776379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.777047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:23.783790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.783916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.784013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.784013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] PATH_INFO: `/v3/projects/cd64f504567c4d178b88d6614832be52/users/7c0c3776e92c490ba4b9e51f563d8c65/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.784168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.784168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] PATH_INFO: `/v3/projects/4018fa97ffbf467e89290cb14851950c/users/db17029c6d8347799a76d9f0c33bc88d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.795884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4018fa97ffbf467e89290cb14851950c, user_id=db17029c6d8347799a76d9f0c33bc88d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.798583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd64f504567c4d178b88d6614832be52, user_id=7c0c3776e92c490ba4b9e51f563d8c65, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:23.798705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71445f-dfda-4a94-875f-86a888a5b96b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.801568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1a28-7072-4b4f-a75b-5ce9e25cf228 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:23.951795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 937/1878] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:23 2022] PUT /identity/v3/projects/cd64f504567c4d178b88d6614832be52/users/7c0c3776e92c490ba4b9e51f563d8c65/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:23.952111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 942/1879] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:23 2022] PUT /identity/v3/projects/4018fa97ffbf467e89290cb14851950c/users/db17029c6d8347799a76d9f0c33bc88d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:23.963744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.964042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.964379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:23.964475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.965369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:23.965655 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:23.993768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] MFA Rules not processed for user `db17029c6d8347799a76d9f0c33bc88d`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:23.995365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.008384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] MFA Rules not processed for user `7c0c3776e92c490ba4b9e51f563d8c65`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:24.009675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.088429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 943/1880] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:24.089377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.092596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 938/1881] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:24.096805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.158565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf803-bd74-4b94-963c-63a764701c94 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.163258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.163927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.164228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.164488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.165214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.165461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056f45b-e822-4d80-adec-624a39f06d2b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.167119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.171147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.172052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.172265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.172576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.173311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.175238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.278104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 944/1882] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:24 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:24.278297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 939/1883] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:24 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:24.282237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.282361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.352436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d99e93-51b6-413c-8178-aca2286ca742 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.356273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a616-6e6a-41c6-89e8-6e69256a9eb5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.360419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.361046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.361578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.361810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.361898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.361978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.362178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.362273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.365474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.365700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.365788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.365861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.474525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 940/1884] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:24 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:24.474721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 945/1885] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:24 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:24.474836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.474836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.475566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.486138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed2c71-9cdb-4508-a7b6-c94a0b8a302f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.487168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842f49-2189-44d0-b040-7d8d7c20acf5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.490849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.491504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.491816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.491952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.492099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.492901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.493187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.493296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.493464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] PATH_INFO: `/v3/users/26f47f03f50e48c08ae953f65e6d7d57` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.494677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f47f03f50e48c08ae953f65e6d7d57)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.494779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.496858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.508148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 946/1886] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:24.508148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.515790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becaf8-54d4-4ae7-ba63-25d601a48895 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.520691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.521693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.522029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.522459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.523256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.525356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.537477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 947/1887] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:24.538398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.548558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6476fe-fb6a-44e6-bca6-9bd69c060bef admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.553164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.554026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.554312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.554590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] PATH_INFO: `/v3/projects/5c7a7a90c120425c8f0da915acf020f7/users/e04e792c7202484493e9294d0f3e4753/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.568875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a7a90c120425c8f0da915acf020f7, user_id=e04e792c7202484493e9294d0f3e4753, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.571503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.681480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 948/1888] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:24 2022] PUT /identity/v3/projects/5c7a7a90c120425c8f0da915acf020f7/users/e04e792c7202484493e9294d0f3e4753/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:24.682601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.721927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f47f03f50e48c08ae953f65e6d7d57'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:24.722612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f47f03f50e48c08ae953f65e6d7d57'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:24.723240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f47f03f50e48c08ae953f65e6d7d57'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:24.735732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f47f03f50e48c08ae953f65e6d7d57'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:24.754281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634aeac-259a-4a1b-a50c-73b69a254e7a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.759400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.760347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.762770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.762770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] PATH_INFO: `/v3/projects/5dca04246afd4f6b8f65d8c97f179013/users/11275c8c1a6f47bb82bd945a25904864/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.776442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dca04246afd4f6b8f65d8c97f179013, user_id=11275c8c1a6f47bb82bd945a25904864, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.780057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e6b73-b361-454a-b4b5-86ada36ff6fc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:24.801902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f47f03f50e48c08ae953f65e6d7d57'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:24.832193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 941/1889] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:24 2022] DELETE /identity/v3/users/26f47f03f50e48c08ae953f65e6d7d57 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:24.833095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.834478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.865482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 949/1890] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:24 2022] PUT /identity/v3/projects/5dca04246afd4f6b8f65d8c97f179013/users/11275c8c1a6f47bb82bd945a25904864/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:24.866823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86214d-a947-4242-b281-0025500e0551 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.867112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86214d-a947-4242-b281-0025500e0551 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.867661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86214d-a947-4242-b281-0025500e0551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.887023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ef86214d-a947-4242-b281-0025500e0551 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:24.889076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ef86214d-a947-4242-b281-0025500e0551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.915254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf4ae-809c-4e1b-a048-6da54b559bdd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.961469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 950/1891] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:24.962570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86214d-a947-4242-b281-0025500e0551 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:24.964293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:24.966291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ef86214d-a947-4242-b281-0025500e0551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:24.980103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86214d-a947-4242-b281-0025500e0551 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:24.985494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:24.986579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:24.987021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:24.987304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:24.988044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:24.989681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.002050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 951/1892] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:25.006331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.006922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.007905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.008304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.008705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.009582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.012255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.017235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.020782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:25.029184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 942/1893] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:25.030037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.049351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fd03-53b2-42c0-ab6e-24483882ebe5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.054551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.055674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.055965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.056309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] PATH_INFO: `/v3/projects/5dca04246afd4f6b8f65d8c97f179013/users/11275c8c1a6f47bb82bd945a25904864/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.059122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dca04246afd4f6b8f65d8c97f179013, user_id=11275c8c1a6f47bb82bd945a25904864, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.062046 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.078138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 943/1894] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:25 2022] PUT /identity/v3/projects/5dca04246afd4f6b8f65d8c97f179013/users/11275c8c1a6f47bb82bd945a25904864/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:25.079766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.157220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6027586-4cfa-4b0c-bbc3-7dcf55f0deee admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.188241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36af0e2-71ec-48b3-9d8b-70667c50f456 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.191784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.192988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.193293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.194044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] PATH_INFO: `/v3/projects/5c7a7a90c120425c8f0da915acf020f7/users/e04e792c7202484493e9294d0f3e4753/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.195896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a7a90c120425c8f0da915acf020f7, user_id=e04e792c7202484493e9294d0f3e4753, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.198788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda9f6-b42e-40f7-a180-d166e39e2ce2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.218586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 944/1895] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:25 2022] PUT /identity/v3/projects/5c7a7a90c120425c8f0da915acf020f7/users/e04e792c7202484493e9294d0f3e4753/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:25.228348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.228348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.228348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.235602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.236375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.236663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.236971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.246741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.248189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc393b6-2454-4514-90bf-c94d6e89d25c service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.249038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] MFA Rules not processed for user `11275c8c1a6f47bb82bd945a25904864`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:25.250260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.261207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 952/1896] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:25.261207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.261207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.261207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.309461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] MFA Rules not processed for user `e04e792c7202484493e9294d0f3e4753`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:25.311295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.359265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 945/1897] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:25.372391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.374202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.408318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 953/1898] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:25.433918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dcc3a-0d38-4e09-954a-ec8202d3ae70 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.437564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.438214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.438528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.438806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.440609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.474723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.476163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.488445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9ee01-1784-4796-b35e-94ab8d87c863 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.492142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.493094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.493380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.493658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.503155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.504189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.504634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.505691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.524871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 946/1899] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:25.528709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 954/1900] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:25.737048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:25.739228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:25.805803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260b98-2c8c-4e6a-b1bd-e97996f0eabe service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:25.810463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:25.811348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:25.811677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:25.811903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] PATH_INFO: `/v3/projects/19c04f41e0864d9f93066a8fb67591bf` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:25.813173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c04f41e0864d9f93066a8fb67591bf)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:25.815096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:25.982458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c04f41e0864d9f93066a8fb67591bf', 'request_id': 'req-f36f0f88-2aaa-4f1b-8b6b-da2100299719'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.097703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c04f41e0864d9f93066a8fb67591bf', 'request_id': 'req-f36f0f88-2aaa-4f1b-8b6b-da2100299719'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.104507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c04f41e0864d9f93066a8fb67591bf', 'request_id': 'req-f36f0f88-2aaa-4f1b-8b6b-da2100299719'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.115561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] The token cache is being invalidate because project 19c04f41e0864d9f93066a8fb67591bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:26.115844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.116705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.118679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 947/1901] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:25 2022] DELETE /identity/v3/projects/19c04f41e0864d9f93066a8fb67591bf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:26.122685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:26.133648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd904c-daa3-42f7-b1ea-c373aca9053e service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:26.189694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:26.190529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:26.190810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:26.191081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] PATH_INFO: `/v3/users/46cc054c4bdb41eebfc9f6f2e9f2304e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:26.192272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cc054c4bdb41eebfc9f6f2e9f2304e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:26.194220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:26.250510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:26.316798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:26.398260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cc054c4bdb41eebfc9f6f2e9f2304e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.407100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cc054c4bdb41eebfc9f6f2e9f2304e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.407814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cc054c4bdb41eebfc9f6f2e9f2304e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.408422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cc054c4bdb41eebfc9f6f2e9f2304e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.512516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:26.513914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:26.561854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cc054c4bdb41eebfc9f6f2e9f2304e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:26.578446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0f88-2aaa-4f1b-8b6b-da2100299719 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:26.586284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 955/1902] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:26 2022] DELETE /identity/v3/users/46cc054c4bdb41eebfc9f6f2e9f2304e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:26.640491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:26.641208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:26.641494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:26.641769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:26.643853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:26.708150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:26.709642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75884f6-d0f1-4aa7-9b63-ba4d9b2b4624 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:26.719186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 948/1903] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:27.130079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:27.133996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:27.224570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fa34-1594-49ad-aa13-68041a99222f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:27.229573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:27.230971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:27.231354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:27.232071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] PATH_INFO: `/v3/projects/7da43c7a0d8a4a9cb49b7ef6a9d8798f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:27.233853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da43c7a0d8a4a9cb49b7ef6a9d8798f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:27.235927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:27.478105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da43c7a0d8a4a9cb49b7ef6a9d8798f', 'request_id': 'req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:27.488934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c36-cae1-4d36-a16b-86bbaef0d8a4 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:27.491330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c36-cae1-4d36-a16b-86bbaef0d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:27.492145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c36-cae1-4d36-a16b-86bbaef0d8a4 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:27.496333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 949/1904] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 12:59:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:27.507186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:27.507186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:27.507186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:27.529508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:27.536687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:27.539280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da43c7a0d8a4a9cb49b7ef6a9d8798f', 'request_id': 'req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:27.550130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da43c7a0d8a4a9cb49b7ef6a9d8798f', 'request_id': 'req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:27.574975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] The token cache is being invalidate because project 7da43c7a0d8a4a9cb49b7ef6a9d8798f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:27.575352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:27.576112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:27.581032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 956/1905] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:27 2022] DELETE /identity/v3/projects/7da43c7a0d8a4a9cb49b7ef6a9d8798f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:27.583698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:27.590477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:27.662943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 950/1906] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:27.714003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:27.716304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:27.734287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8ba9b-c292-422e-8961-2313ca2970bf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:27.740435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:27.741619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:27.742110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:27.743202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:27.743435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09b49-d6d4-4c4c-9e11-b208406e4fa2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:27.753725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:27.754654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:27.754965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:27.755370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] PATH_INFO: `/v3/users/57e5ee1cc95040ae91ad8774d97fc390` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:27.756734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e5ee1cc95040ae91ad8774d97fc390)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:27.759225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:27.794204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:27.796082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:27.807624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 951/1907] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:28.016150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e5ee1cc95040ae91ad8774d97fc390'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:28.023266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e5ee1cc95040ae91ad8774d97fc390'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:28.023992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e5ee1cc95040ae91ad8774d97fc390'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:28.024662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e5ee1cc95040ae91ad8774d97fc390'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:28.115902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e5ee1cc95040ae91ad8774d97fc390'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:28.133901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 957/1908] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:27 2022] DELETE /identity/v3/users/57e5ee1cc95040ae91ad8774d97fc390 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:28.705279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:28.721539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f3a1-d21c-47ea-9de6-f6665cd84ac5 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:28.809930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:28.811156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:28.811511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:28.811916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] PATH_INFO: `/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:28.813281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5180bb0ebdd495db8971efc7ecafd8b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:28.815224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:29.075007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5180bb0ebdd495db8971efc7ecafd8b', 'request_id': 'req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.128073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:29.217454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5180bb0ebdd495db8971efc7ecafd8b', 'request_id': 'req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.229776 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5180bb0ebdd495db8971efc7ecafd8b', 'request_id': 'req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.250388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] The token cache is being invalidate because project e5180bb0ebdd495db8971efc7ecafd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:29.250835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.251933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383c0c86-350d-4d2b-8dbc-fd45e43e9bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.254337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 952/1909] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:28 2022] DELETE /identity/v3/projects/e5180bb0ebdd495db8971efc7ecafd8b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:29.305368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:29.548953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:29.548953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:29.561910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f3a2-ae97-444f-89ed-85130f0f1a55 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:29.621412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:29.622302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:29.622591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:29.622871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] PATH_INFO: `/v3/users/52bbe241d5434a5fbd464182b1c98bb3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:29.624154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bbe241d5434a5fbd464182b1c98bb3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:29.626141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:29.917993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bbe241d5434a5fbd464182b1c98bb3'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.925042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bbe241d5434a5fbd464182b1c98bb3'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.925718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bbe241d5434a5fbd464182b1c98bb3'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:29.926342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bbe241d5434a5fbd464182b1c98bb3'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.043616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bbe241d5434a5fbd464182b1c98bb3'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.064951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 958/1910] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:29 2022] DELETE /identity/v3/users/52bbe241d5434a5fbd464182b1c98bb3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:30.069838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:30.070338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:30.070430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:30.091129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:30.092448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.158209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 953/1911] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:30.168137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:30.169609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.236350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e291-3c03-4067-8db9-606d19abccf5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:30.240191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:30.241212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:30.241648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:30.242090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:30.265175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:30.267407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7f9d1-73b3-4250-b502-1986d5a5b84d service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:30.282696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 959/1912] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:30.331885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:30.337703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.345901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1a75f-ebe9-4d20-968d-101199972023 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:30.351257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:30.352154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:30.352808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:30.353092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] PATH_INFO: `/v3/users/7c0c3776e92c490ba4b9e51f563d8c65` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:30.354403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0c3776e92c490ba4b9e51f563d8c65)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:30.356438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:30.590490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0c3776e92c490ba4b9e51f563d8c65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.591167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0c3776e92c490ba4b9e51f563d8c65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.593014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0c3776e92c490ba4b9e51f563d8c65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.602739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0c3776e92c490ba4b9e51f563d8c65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.700292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0c3776e92c490ba4b9e51f563d8c65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:30.720651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 954/1913] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:30 2022] DELETE /identity/v3/users/7c0c3776e92c490ba4b9e51f563d8c65 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:30.725974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:30.726785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:30.731404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:30.746017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:30.747254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.819092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 960/1914] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:30.826457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:30.827917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.880521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:30.917062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa73-d250-48e7-a240-825d8b32969a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:30.924253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:30.924253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:30.924253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:30.924253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:30.933701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:30.935185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:30.947030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 955/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:30.983412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:30.985462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:30.998456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076f63-0f16-46aa-824c-b19a2ee33221 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:31.004329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:31.005350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:31.006064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:31.006571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] PATH_INFO: `/v3/projects/36c1910b47f845d48b61915d787a3e99` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:31.007840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c1910b47f845d48b61915d787a3e99)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:31.009958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:31.157780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c1910b47f845d48b61915d787a3e99', 'request_id': 'req-1b735734-e5b2-48b3-b0ee-4807c15cce9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.259578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c1910b47f845d48b61915d787a3e99', 'request_id': 'req-1b735734-e5b2-48b3-b0ee-4807c15cce9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.272622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c1910b47f845d48b61915d787a3e99', 'request_id': 'req-1b735734-e5b2-48b3-b0ee-4807c15cce9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.293010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] The token cache is being invalidate because project 36c1910b47f845d48b61915d787a3e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:31.293640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.311674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.316525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 961/1916] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:30 2022] DELETE /identity/v3/projects/36c1910b47f845d48b61915d787a3e99 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:31.321206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:31.334941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ae29-ab8e-4bec-bd12-fbda1251716f service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:31.460781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:31.462492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:31.462492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:31.462492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] PATH_INFO: `/v3/users/2439ba596d8e44218c31a45badc2d9ae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:31.464975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2439ba596d8e44218c31a45badc2d9ae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:31.467220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:31.514645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:31.516418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:31.535357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735734-e5b2-48b3-b0ee-4807c15cce9a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:31.541373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:31.542415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:31.542899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:31.550254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] PATH_INFO: `/v3/projects/cd64f504567c4d178b88d6614832be52` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:31.550254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd64f504567c4d178b88d6614832be52)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:31.550254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:31.682763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:31.699994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2439ba596d8e44218c31a45badc2d9ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.700652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2439ba596d8e44218c31a45badc2d9ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.701347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2439ba596d8e44218c31a45badc2d9ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.701482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd64f504567c4d178b88d6614832be52', 'request_id': 'req-193a40d8-a63f-49d2-b62e-6d1626bd0adc'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.708328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2439ba596d8e44218c31a45badc2d9ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.825616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd64f504567c4d178b88d6614832be52', 'request_id': 'req-193a40d8-a63f-49d2-b62e-6d1626bd0adc'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.833454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd64f504567c4d178b88d6614832be52', 'request_id': 'req-193a40d8-a63f-49d2-b62e-6d1626bd0adc'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.846100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] The token cache is being invalidate because project cd64f504567c4d178b88d6614832be52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:31.846390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.847064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.848943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 962/1917] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:31 2022] DELETE /identity/v3/projects/cd64f504567c4d178b88d6614832be52 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:31.852793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:31.854169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:31.904756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2439ba596d8e44218c31a45badc2d9ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:31.938876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a40d8-a63f-49d2-b62e-6d1626bd0adc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:31.939461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 956/1918] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:31 2022] DELETE /identity/v3/users/2439ba596d8e44218c31a45badc2d9ae => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:32.047355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:32.049421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:32.049958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:32.050439 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] PATH_INFO: `/v3/users/11275c8c1a6f47bb82bd945a25904864` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:32.052106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11275c8c1a6f47bb82bd945a25904864)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:32.055077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:32.335605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11275c8c1a6f47bb82bd945a25904864'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.344174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11275c8c1a6f47bb82bd945a25904864'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.345256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11275c8c1a6f47bb82bd945a25904864'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.345815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11275c8c1a6f47bb82bd945a25904864'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.413331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b74bffb4-d6ab-4aef-b221-32741bbe5b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11275c8c1a6f47bb82bd945a25904864'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.435392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 963/1919] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:31 2022] DELETE /identity/v3/users/11275c8c1a6f47bb82bd945a25904864 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:32.514987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:32.516503 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:32.530243 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa441e-8801-47f0-83f1-951b24747a53 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:32.596378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:32.597761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:32.598048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:32.598345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] PATH_INFO: `/v3/projects/d89b6cf899dc42059b469d6e83dbe261` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:32.599527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89b6cf899dc42059b469d6e83dbe261)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:32.603583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:32.723633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89b6cf899dc42059b469d6e83dbe261', 'request_id': 'req-27896f82-f4d8-4f58-8a89-b530fff2d951'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.790236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89b6cf899dc42059b469d6e83dbe261', 'request_id': 'req-27896f82-f4d8-4f58-8a89-b530fff2d951'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.801376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89b6cf899dc42059b469d6e83dbe261', 'request_id': 'req-27896f82-f4d8-4f58-8a89-b530fff2d951'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.811825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] The token cache is being invalidate because project d89b6cf899dc42059b469d6e83dbe261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:32.812171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.812895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-27896f82-f4d8-4f58-8a89-b530fff2d951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:32.816447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 957/1920] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:32 2022] DELETE /identity/v3/projects/d89b6cf899dc42059b469d6e83dbe261 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:32.819923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:32.820217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:32.820499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:32.839094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:32.840836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:32.913262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 964/1921] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:32.921937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:32.922231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:32.922512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:32.941202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:32.942391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:32.950923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 958/1922] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:32.955646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:32.966521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338587-5835-4a73-92e5-b0fdf6134367 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:32.971390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:32.972141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:32.972430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:32.972738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:32.973482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:32.973798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:32.975404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:32.990489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 965/1923] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:32.993663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:32.995257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:32.999980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.016144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40265e-b5b5-48fe-a989-60e24fc51921 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.026993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d693-5874-4ae3-873b-317f547f5004 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.032346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.032346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.032346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.032346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] PATH_INFO: `/v3/projects/5dca04246afd4f6b8f65d8c97f179013` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.033297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dca04246afd4f6b8f65d8c97f179013)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.033389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.033389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.033556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.033637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.033637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.033950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.036148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.152041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 966/1924] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:33.153500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.159489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dca04246afd4f6b8f65d8c97f179013', 'request_id': 'req-3f54d3c8-16da-413e-9f76-8457cdaea4db'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:33.239549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef7da8-deff-4f35-8c74-d136faa5a8c3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.246645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.247359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.247700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.247985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.248906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.250877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.264842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dca04246afd4f6b8f65d8c97f179013', 'request_id': 'req-3f54d3c8-16da-413e-9f76-8457cdaea4db'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:33.273915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dca04246afd4f6b8f65d8c97f179013', 'request_id': 'req-3f54d3c8-16da-413e-9f76-8457cdaea4db'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:33.290684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] The token cache is being invalidate because project 5dca04246afd4f6b8f65d8c97f179013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:33.291030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:33.291863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3f54d3c8-16da-413e-9f76-8457cdaea4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:33.294754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 959/1925] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:32 2022] DELETE /identity/v3/projects/5dca04246afd4f6b8f65d8c97f179013 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:33.313752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35196421-ef46-4032-a6e9-2de39c49b000 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.314135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35196421-ef46-4032-a6e9-2de39c49b000 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.314605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35196421-ef46-4032-a6e9-2de39c49b000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.335897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-35196421-ef46-4032-a6e9-2de39c49b000 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:33.337404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-35196421-ef46-4032-a6e9-2de39c49b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:33.351935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 960/1926] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:33.363297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.363589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.363891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.399680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 967/1927] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:33.411322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.413447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:33.416974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:33.418897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:33.428446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782fe7-e216-4d59-9c44-0366beb6f9f3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.432640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 961/1928] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:33.433591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.436205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.436981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.437333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.437622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.442832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.442832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.443675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa66ab-c70c-4094-8887-66459606a1fe None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.448898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.449702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.449997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.450279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.451024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:33.451650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.453021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.465771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:33.465955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 968/1929] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:33.467542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.469095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 962/1930] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:33.476404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.479536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79c24-9764-4869-9eed-4499437d4684 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.488704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04336d9-5ba4-4a23-be2c-69ad9804fb52 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.488908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.489706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.490015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.491314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.492174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.495250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.498649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.500368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.502051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.502661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.505601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.507956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.511517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 969/1931] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:33.517077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.531302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075da69-c4a3-4ae0-9a85-6a5624e6f8e8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.538961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.539419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.539919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.540378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] PATH_INFO: `/v3/projects/18c4cbf4ccd34a3bb334195c09d47b21/users/1f91b69cf4fc484fb21c162f9a1d5c13/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.563892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c4cbf4ccd34a3bb334195c09d47b21, user_id=1f91b69cf4fc484fb21c162f9a1d5c13, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.566669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd17a-8db0-4819-8048-d1e0c224b26d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.649640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:33.659383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 963/1933] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:33.662201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 970/1932] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:33 2022] PUT /identity/v3/projects/18c4cbf4ccd34a3bb334195c09d47b21/users/1f91b69cf4fc484fb21c162f9a1d5c13/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:33.663521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.666995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.667701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.667701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.695234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] MFA Rules not processed for user `1f91b69cf4fc484fb21c162f9a1d5c13`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:33.696562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:33.729045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9426-dbd7-4f5e-b725-1e6104321ed9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.733848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.734522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.734804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.735079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.735813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.737768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.764646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 971/1934] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:33.769222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.780578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480da3c-bb64-4be0-8227-30c3bc428438 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.785166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.785830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.786114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.786388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.787114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.789141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.882123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 964/1935] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:33.882234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 972/1936] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:33.882688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.883777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.893062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53608b-ea4f-4882-90de-e1a17bc5ff76 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.968936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf4a1-180f-4679-9d86-4ff1d133bd38 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:33.978897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.979581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.979990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.980390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.981184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.982799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:33.993372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 965/1937] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:33.994337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:33.995360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:33.996327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:33.996611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:33.997567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:33.998621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:33.999573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.008971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4635dd-3917-42f3-887f-5f2d15186510 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.014444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.015142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.015503 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.015843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.016647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.018475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.037360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 966/1938] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:34.041574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.077293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bdec-1533-4fa9-b466-edfe1d156cd2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.084025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.084972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.085281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.085621 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] PATH_INFO: `/v3/projects/8abe7ab1ba4e46c78c5755d3150d39f8/users/7a075b995e9d4c558f5dce6edb696b2b/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.115859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abe7ab1ba4e46c78c5755d3150d39f8, user_id=7a075b995e9d4c558f5dce6edb696b2b, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.118801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 973/1939] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:33 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:34.123256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198db9da-2c9f-409d-a8c6-9434315462ac admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.124211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.137771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac31be-987b-49f3-8161-25a4854c6157 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.142735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.143571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.143975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.144355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.145235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.146931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.158606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 974/1940] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:34.162292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.176331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea7e3-1dda-49c4-8488-a726b51992b7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.201628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.203495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.203495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.204704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.205575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.207986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.216120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 967/1941] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:34 2022] PUT /identity/v3/projects/8abe7ab1ba4e46c78c5755d3150d39f8/users/7a075b995e9d4c558f5dce6edb696b2b/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:34.231492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.231982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.232317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.245966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 975/1942] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:34.250948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.272824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093daf-5f00-4f6c-a7eb-94e345a0df99 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.275853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] MFA Rules not processed for user `7a075b995e9d4c558f5dce6edb696b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:34.277161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:34.357247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 968/1943] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:34.360630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.361882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.362425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.365043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] PATH_INFO: `/v3/projects/d31056e3be0d423786ee8ea3c1956bc2/users/bb5e30c3413d440896ae462b2427d3e0/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.373908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.378156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:34.393443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31056e3be0d423786ee8ea3c1956bc2, user_id=bb5e30c3413d440896ae462b2427d3e0, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.397297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae7060-79fb-48f1-a261-7b9548794132 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.463417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380af3-b926-47f2-bcde-5c02d3f89307 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.468266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f114-764e-4a51-991b-57379675978a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.469178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f114-764e-4a51-991b-57379675978a service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.469374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f114-764e-4a51-991b-57379675978a service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.469729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f114-764e-4a51-991b-57379675978a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.478443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9f114-764e-4a51-991b-57379675978a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.480564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9f114-764e-4a51-991b-57379675978a service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.490282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 969/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:34.491169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f114-764e-4a51-991b-57379675978a service glance] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.492770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aec9f114-764e-4a51-991b-57379675978a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:34.511635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 976/1945] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:34 2022] PUT /identity/v3/projects/d31056e3be0d423786ee8ea3c1956bc2/users/bb5e30c3413d440896ae462b2427d3e0/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:34.517331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f114-764e-4a51-991b-57379675978a service glance] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.521445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.523251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.523544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.567487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] MFA Rules not processed for user `bb5e30c3413d440896ae462b2427d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:34.568834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:34.608334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.609498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.609963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.610413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] PATH_INFO: `/v3/users/db17029c6d8347799a76d9f0c33bc88d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.613061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db17029c6d8347799a76d9f0c33bc88d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.617985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.665273 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 977/1946] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:34.671509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.682946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee10e9a-2d13-49ef-9f38-ba9a5b203a75 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.688502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.689225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.689511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.689797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.690597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.692640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.787035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db17029c6d8347799a76d9f0c33bc88d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:34.788016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db17029c6d8347799a76d9f0c33bc88d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:34.788708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db17029c6d8347799a76d9f0c33bc88d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:34.798312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:34.800664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db17029c6d8347799a76d9f0c33bc88d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:34.807145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 978/1947] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:34 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:34.811190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:34.813146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:34.871258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:34.890047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9188-f2ac-4e37-9e30-4c1d67e76341 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:34.893035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-59777243-1655-4f86-a14e-9e0014893eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db17029c6d8347799a76d9f0c33bc88d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:34.905838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:34.905838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.905838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.905838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.906243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:34.907225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:34.914003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 970/1948] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:34 2022] DELETE /identity/v3/users/db17029c6d8347799a76d9f0c33bc88d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:34.919631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:34.920151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:34.920387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:34.942643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:34.943872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:35.005161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 971/1949] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:35.015839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.017431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:35.034594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 979/1950] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:34 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:35.035537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.053165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea800-2c89-4b63-b916-e9fc0ed3ebd3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.059072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.059516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.059804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.060088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.060856 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.062492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.076807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 980/1951] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:35.077922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.082677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32fa0c-9117-4759-a57d-114e7eb242eb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.087505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.087505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.088025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.088407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.089881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8396-74ea-4562-bdef-a7adf0b7ea0b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.095246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.096198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.096499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.096954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] PATH_INFO: `/v3/projects/8280f45156e646cd9be114d6512bda40/users/29fc291e214042ecaa1a1f73fcddc094/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.099363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.100969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.112384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 972/1952] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:35.119599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8280f45156e646cd9be114d6512bda40, user_id=29fc291e214042ecaa1a1f73fcddc094, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.122528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.236560 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 981/1953] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:35 2022] PUT /identity/v3/projects/8280f45156e646cd9be114d6512bda40/users/29fc291e214042ecaa1a1f73fcddc094/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:35.240320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.252579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3240d-22bf-4b51-a75a-c2cd1a14507e service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.320274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.321260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.321799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.322499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.323069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.325849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be568-3cf4-4f27-ae0f-3ab1e760f34c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.340710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 973/1954] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:35.343157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.354074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597322-0016-47d2-a8e3-2800bcde4e32 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.360333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.360333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.360333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.360923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] PATH_INFO: `/v3/projects/8280f45156e646cd9be114d6512bda40/users/29fc291e214042ecaa1a1f73fcddc094/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.362867 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8280f45156e646cd9be114d6512bda40, user_id=29fc291e214042ecaa1a1f73fcddc094, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.365598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.377810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 982/1955] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:35 2022] PUT /identity/v3/projects/8280f45156e646cd9be114d6512bda40/users/29fc291e214042ecaa1a1f73fcddc094/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:35.390115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.390831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.391129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.423039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] MFA Rules not processed for user `29fc291e214042ecaa1a1f73fcddc094`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:35.423039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:35.512752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 974/1956] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:35.529331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.531054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:35.615846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934750d-8060-4ed3-89b8-c1fd0696aae8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.624819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.626129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.626419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.626697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.636790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.638168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.638297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:35.639702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.669403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 983/1957] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:35.726351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572717-e354-45c5-828c-0f97b15eca40 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:35.728498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:35.729420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:35.729708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:35.730586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] PATH_INFO: `/v3/projects/4018fa97ffbf467e89290cb14851950c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:35.731836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4018fa97ffbf467e89290cb14851950c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:35.733808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:35.865795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:35.877562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4018fa97ffbf467e89290cb14851950c', 'request_id': 'req-2c0f592d-feba-4c71-b477-8ca7532b822b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:35.928208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4018fa97ffbf467e89290cb14851950c', 'request_id': 'req-2c0f592d-feba-4c71-b477-8ca7532b822b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:35.940862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4018fa97ffbf467e89290cb14851950c', 'request_id': 'req-2c0f592d-feba-4c71-b477-8ca7532b822b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:35.947933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] The token cache is being invalidate because project 4018fa97ffbf467e89290cb14851950c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:35.948226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:35.948968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:35.950601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 975/1958] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:35 2022] DELETE /identity/v3/projects/4018fa97ffbf467e89290cb14851950c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:35.954464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:35.965493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47e5c-3989-4d87-8be5-ec8e5221073d service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:36.024923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:36.025892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:36.026176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:36.026451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] PATH_INFO: `/v3/users/e04e792c7202484493e9294d0f3e4753` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:36.028515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04e792c7202484493e9294d0f3e4753)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:36.030584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:36.285857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04e792c7202484493e9294d0f3e4753'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:36.294595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04e792c7202484493e9294d0f3e4753'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:36.295460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04e792c7202484493e9294d0f3e4753'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:36.296151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04e792c7202484493e9294d0f3e4753'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:36.384819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04e792c7202484493e9294d0f3e4753'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:36.428131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 984/1959] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:35 2022] DELETE /identity/v3/users/e04e792c7202484493e9294d0f3e4753 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:36.515453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:36.927599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:36.929841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:36.934488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:36.968369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f592d-feba-4c71-b477-8ca7532b822b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.085136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.085136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.085671 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.086025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] PATH_INFO: `/v3/projects/5c7a7a90c120425c8f0da915acf020f7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.087351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7a7a90c120425c8f0da915acf020f7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.090077 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.123402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:37.123402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:37.165537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281890f-d7c0-4a27-b3ea-77864b3795d6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.170348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.171125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.171477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.172039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.174263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:37.241548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7a7a90c120425c8f0da915acf020f7', 'request_id': 'req-93ceab94-44be-459b-b0fc-f3a3be4efb80'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:37.261928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.263380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7745-a395-4718-b465-adcfb3681e60 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.278930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 985/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:37.311016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7a7a90c120425c8f0da915acf020f7', 'request_id': 'req-93ceab94-44be-459b-b0fc-f3a3be4efb80'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:37.316707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:37.325196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7a7a90c120425c8f0da915acf020f7', 'request_id': 'req-93ceab94-44be-459b-b0fc-f3a3be4efb80'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:37.350312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] The token cache is being invalidate because project 5c7a7a90c120425c8f0da915acf020f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:37.350859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:37.352379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-93ceab94-44be-459b-b0fc-f3a3be4efb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:37.354483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 976/1961] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:36 2022] DELETE /identity/v3/projects/5c7a7a90c120425c8f0da915acf020f7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:37.360638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.361600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.362097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.399976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:37.402363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:37.513363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 986/1962] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:37.515184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.515487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.515829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.541516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:37.542808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:37.552914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 977/1963] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:37.557132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:37.571852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080742a-0128-4996-8709-f2b3d193a0f6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.579915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.580730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.581053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.581353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.582083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:37.583106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.584021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.597233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 987/1964] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:59:37.602451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:37.613611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37558-6c34-40e5-86ef-a7c23358c5ea None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.618840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.619514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.619806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.620225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.621063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.623233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.752225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 978/1965] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:37 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:37.754526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:37.767638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60d3c-3ca4-43a9-b6ff-d1ef87905dc5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.855562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.856554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.856960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.857335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.858117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.860171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.952726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 988/1966] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:37 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:37.956445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:37.967658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dc0e-c30e-49b1-b3f8-2e43c1166521 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:37.974904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:37.975722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:37.976103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:37.976509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:37.977804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:37.981333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:37.991123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 979/1967] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:37.995210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.014759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcc406-28e8-4f97-8688-3bf0b87d9aba admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.015076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.015800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.016092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.016441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.017261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.024503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c8201-9581-46f5-91fa-d67ba05c37ee admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:38.032928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 989/1968] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:38.035654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.049461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063c28-59a2-4da7-ad34-d9b6b2923b33 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.054875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.055820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.056105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.056385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] PATH_INFO: `/v3/projects/0fc1a476e47b4943a066a01077dfaa7d/users/918b1f91ec2346aeb94217d18daf8af1/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.075967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc1a476e47b4943a066a01077dfaa7d, user_id=918b1f91ec2346aeb94217d18daf8af1, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.078739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:38.159445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 980/1969] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:38 2022] PUT /identity/v3/projects/0fc1a476e47b4943a066a01077dfaa7d/users/918b1f91ec2346aeb94217d18daf8af1/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:38.172256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.172813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.172907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.209804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] MFA Rules not processed for user `918b1f91ec2346aeb94217d18daf8af1`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:38.211542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:38.244062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:38.339451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 990/1970] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:38.344460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.464985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349b290-4c77-4c5a-846a-1cd7bde50140 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.472265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.472265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.472265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.472265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.472794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.474422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:38.603070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 981/1971] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:38 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:38.607520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.624432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbb908-b880-48e4-846b-b7809f018ab2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.735352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.736114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.736402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.736787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.737563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.739665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:38.850133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 991/1972] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:38 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:38.854238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.869344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b4409-f3c8-4dd2-8cbf-72e203385ffc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.882940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.887953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.887953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.887953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.887953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.888554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:38.907254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 982/1973] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:38.909480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:38.926147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a99a3-938a-4ea9-a063-bc5e53778515 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:38.931881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:38.932905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:38.933228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:38.933503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] PATH_INFO: `/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e/users/c98e9e7037d444dbbda3b315e77eef8c/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:38.952000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48efbcd0a4b343ecb813f667c8c1b56e, user_id=c98e9e7037d444dbbda3b315e77eef8c, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:38.955028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:39.116150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 992/1974] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:38 2022] PUT /identity/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e/users/c98e9e7037d444dbbda3b315e77eef8c/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:39.120359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:39.131505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1469-31b8-4aa1-95c2-27d22c57c7bd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:39.203019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:39.231213 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:39.231918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:39.232209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:39.232510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:39.233301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:39.235003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15951a-d61b-4984-bdf2-225f86130990 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:39.248655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 983/1975] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:39.254049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:39.268978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f5-cbe1-469e-b6a3-ed069dff1074 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:39.285398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:39.287362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:39.287874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:39.288356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] PATH_INFO: `/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e/users/c98e9e7037d444dbbda3b315e77eef8c/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:39.292939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48efbcd0a4b343ecb813f667c8c1b56e, user_id=c98e9e7037d444dbbda3b315e77eef8c, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:39.296455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:39.309653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 993/1976] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:39 2022] PUT /identity/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e/users/c98e9e7037d444dbbda3b315e77eef8c/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:39.321280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:39.321984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:39.322564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:39.351839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] MFA Rules not processed for user `c98e9e7037d444dbbda3b315e77eef8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:39.353209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:39.436448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 984/1977] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:39.506969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:39.509201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:39.576689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ace39-5b09-47a8-bf21-acb54bf330a5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:39.580854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:39.581614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:39.581927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:39.582202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:39.596582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:39.603074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539e52b-90dd-44a0-a559-d0a709ee5afc service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:39.615048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 994/1978] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:39.665007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:40.070762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:40.493485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:40.613019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:40.976386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:41.069515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33fbfe-d0ac-4b11-b593-7ac58429c436 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:41.075692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:41.076646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:41.082408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:41.082408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] PATH_INFO: `/v3/users/918b1f91ec2346aeb94217d18daf8af1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:41.082408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=918b1f91ec2346aeb94217d18daf8af1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:41.082408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:41.174373 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:41.264857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:41.323469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918b1f91ec2346aeb94217d18daf8af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:41.324634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918b1f91ec2346aeb94217d18daf8af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:41.325599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918b1f91ec2346aeb94217d18daf8af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:41.334351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918b1f91ec2346aeb94217d18daf8af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:41.387805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918b1f91ec2346aeb94217d18daf8af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:41.422280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 985/1979] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:40 2022] DELETE /identity/v3/users/918b1f91ec2346aeb94217d18daf8af1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:41.426801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:41.427092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:41.427371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:41.449058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:41.450322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:41.527061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 995/1980] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:41.538120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:41.539914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:41.646924 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ca07-0eea-45e6-be49-0da3e33cee5b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:41.649524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:41.650255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:41.650546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:41.650828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:41.666372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:41.677615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:41.677960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:41.692494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:41.701813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 986/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:42.192375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:42.193873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:42.208075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfce9f-a104-40e6-9d8a-2f5cc9464395 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:42.213695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:42.215504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:42.216698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:42.217507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] PATH_INFO: `/v3/projects/0fc1a476e47b4943a066a01077dfaa7d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:42.230026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc1a476e47b4943a066a01077dfaa7d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:42.233020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:42.368249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc1a476e47b4943a066a01077dfaa7d', 'request_id': 'req-d10f6157-2860-44a7-b5ad-3333afc4469d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.512092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc1a476e47b4943a066a01077dfaa7d', 'request_id': 'req-d10f6157-2860-44a7-b5ad-3333afc4469d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.518961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc1a476e47b4943a066a01077dfaa7d', 'request_id': 'req-d10f6157-2860-44a7-b5ad-3333afc4469d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.529770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] The token cache is being invalidate because project 0fc1a476e47b4943a066a01077dfaa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:42.530056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.530700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.532245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 996/1982] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:42 2022] DELETE /identity/v3/projects/0fc1a476e47b4943a066a01077dfaa7d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:42.536192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:42.546889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f4f21-0178-4ad5-b2f8-253be7827347 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:42.604167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:42.605987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:42.606286 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:42.606564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] PATH_INFO: `/v3/users/c98e9e7037d444dbbda3b315e77eef8c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:42.608132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98e9e7037d444dbbda3b315e77eef8c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:42.610170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:42.727365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:42.797996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98e9e7037d444dbbda3b315e77eef8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.798660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98e9e7037d444dbbda3b315e77eef8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.799272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98e9e7037d444dbbda3b315e77eef8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.806518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98e9e7037d444dbbda3b315e77eef8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.869896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0bcb8da0-8d01-44ad-8eba-239701ca8a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98e9e7037d444dbbda3b315e77eef8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:42.882803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:42.889442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 987/1983] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:42 2022] DELETE /identity/v3/users/c98e9e7037d444dbbda3b315e77eef8c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:43.196075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:43.223878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:43.334000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:43.338578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:43.350796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6157-2860-44a7-b5ad-3333afc4469d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:43.411646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:43.412596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.412941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.413223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] PATH_INFO: `/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.414541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48efbcd0a4b343ecb813f667c8c1b56e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:43.416522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:43.541384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48efbcd0a4b343ecb813f667c8c1b56e', 'request_id': 'req-c89a10a4-c19d-4426-8a27-caf3ae23eee6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:43.623105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48efbcd0a4b343ecb813f667c8c1b56e', 'request_id': 'req-c89a10a4-c19d-4426-8a27-caf3ae23eee6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:43.629962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48efbcd0a4b343ecb813f667c8c1b56e', 'request_id': 'req-c89a10a4-c19d-4426-8a27-caf3ae23eee6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:43.640761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] The token cache is being invalidate because project 48efbcd0a4b343ecb813f667c8c1b56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:43.641053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:43.641686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c89a10a4-c19d-4426-8a27-caf3ae23eee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:43.643234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 997/1984] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:43 2022] DELETE /identity/v3/projects/48efbcd0a4b343ecb813f667c8c1b56e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:43.648477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.649055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.649279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.669642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:43.670865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:43.732523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 988/1985] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:43.740394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.740877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.740966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.759887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:43.763477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:43.769764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 998/1986] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:43.774295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:43.784211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccedf8b-12e0-4ea9-a240-2a740b29c260 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:43.792235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:43.792961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.793258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.793537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.794317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:43.800186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:43.800186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:43.809219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 989/1987] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:59:43.813473 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:43.822984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3212-9f34-428f-b0c3-15036ec36b72 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:43.828340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:43.829115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.829400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.829677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.830381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:43.832340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:43.863787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:43.916125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:43.916295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 999/1988] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:43 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:43.920702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:43.933994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271298-8074-4254-a537-9a65a6a68f10 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:43.990169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:43.990867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:43.991160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:43.991438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:43.992145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:43.994460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.098616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 990/1989] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:43 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:44.102531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.113664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b6b3-b838-4838-a2d5-0da0f8737bda admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.118773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.119438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.119721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.120045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.121853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.123449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.133814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1000/1990] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:44.137954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.147929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edc406-71b5-483a-8d11-5623f8835dae admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.153155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.154999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.154999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.154999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.155432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.157184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1a962-0f67-4131-b9e3-312528ef7b84 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.169921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 991/1991] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:44.172899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.174254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.185519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d371-0316-49a3-8341-6ad1213c19b8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.190181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.191063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.191349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.191627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] PATH_INFO: `/v3/projects/2ac31cf2a25f4a51ac7b6271db49b99f/users/cf12b23e122143978def02ab947ffe14/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.201764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.208261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac31cf2a25f4a51ac7b6271db49b99f, user_id=cf12b23e122143978def02ab947ffe14, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.212339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.287674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1001/1992] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:44 2022] PUT /identity/v3/projects/2ac31cf2a25f4a51ac7b6271db49b99f/users/cf12b23e122143978def02ab947ffe14/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:44.298623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.298923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.299202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.325832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] MFA Rules not processed for user `cf12b23e122143978def02ab947ffe14`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:44.327056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:44.379387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.392734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 992/1993] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:44.397384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.429548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.463069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369ffc-65e3-4d03-a363-098f27dfc86d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.468958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.469632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.469953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.470237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.470942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.477549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.572119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1002/1994] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:44 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:44.572880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.584189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da76be-6682-491c-9621-8da0a19bb170 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.624839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.650539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.651741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.652038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.652318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.653052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.655015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.659137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:44.789747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 993/1995] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:44 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:44.801608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.810658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.812881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736aa16-677d-4793-a007-bc3713345404 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.813697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:44.817518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.820118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.820118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.820118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.820118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.821412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.837057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1003/1996] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:44.838119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.851395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70825da8-ae53-4d24-b2d1-64487ab10ad0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.857345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.858409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.858550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.858793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] PATH_INFO: `/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c/users/224dfba1b39248dea6298af2de5bd743/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.875740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb5ee6c1b974fd4b2f7bc413beb170c, user_id=224dfba1b39248dea6298af2de5bd743, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.878478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.883103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf95c41-782a-4219-a865-b7845f0b5995 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:44.888053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:44.889733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:44.889733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:44.889733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:44.891194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:44.955229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:44.956749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:44.968268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 994/1997] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:44.973380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1004/1998] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:44 2022] PUT /identity/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c/users/224dfba1b39248dea6298af2de5bd743/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:44.977453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:44.989547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318c119-f658-44e6-94b9-6d18e4bab31c service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:45.062548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:45.064259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:45.065061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:45.065409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:45.065744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:45.066529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:45.068172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca35e2-8903-49a4-a230-b39ab8746baf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:45.079154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 995/1999] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:45.083111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:45.095975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345083f5-b374-4d03-8395-356b76f2d153 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:45.101591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:45.102934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:45.103261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:45.103540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] PATH_INFO: `/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c/users/224dfba1b39248dea6298af2de5bd743/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:45.106449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb5ee6c1b974fd4b2f7bc413beb170c, user_id=224dfba1b39248dea6298af2de5bd743, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:45.109419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:45.121357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1005/2000] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:45 2022] PUT /identity/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c/users/224dfba1b39248dea6298af2de5bd743/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:45.132961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:45.133255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:45.133532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:45.163732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] MFA Rules not processed for user `224dfba1b39248dea6298af2de5bd743`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:45.166308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:45.240689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 996/2001] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:45.252510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:45.254423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:45.318980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02103be2-a27b-4500-86f4-62b6d8298dcb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:45.322726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:45.324211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:45.324211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:45.324763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:45.372333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:45.383777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:45.385250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc9f0e-93d0-4b48-bb59-32589ef91d44 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:45.395163 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1006/2002] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:45.620846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:49.826094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:49.827568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:49.832527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:49.891061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16738c-9795-4725-90b5-05b2283692b6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:49.895556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:49.896432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:49.896737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:49.897015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] PATH_INFO: `/v3/users/1f91b69cf4fc484fb21c162f9a1d5c13` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:49.898201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f91b69cf4fc484fb21c162f9a1d5c13)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:49.900111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:50.066233 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f91b69cf4fc484fb21c162f9a1d5c13'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:50.066886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f91b69cf4fc484fb21c162f9a1d5c13'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:50.067490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f91b69cf4fc484fb21c162f9a1d5c13'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:50.074367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f91b69cf4fc484fb21c162f9a1d5c13'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:50.132149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f91b69cf4fc484fb21c162f9a1d5c13'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:50.150119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 997/2003] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:49 2022] DELETE /identity/v3/users/1f91b69cf4fc484fb21c162f9a1d5c13 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:50.155216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:50.155699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:50.155797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:50.173354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:50.174559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:50.233150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1007/2004] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:50.245575 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:50.247155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:50.303689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf05d7-4c1d-4364-82ed-d9725efaff40 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:50.308086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:50.308889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:50.309244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:50.309526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:50.320169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:50.321628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:50.331360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 998/2005] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:50.745349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:50.751917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:50.767619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa2a09-7b74-4f7e-b0a7-bc5639727ec7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:50.778278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:50.781075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:50.781075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:50.781075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] PATH_INFO: `/v3/projects/18c4cbf4ccd34a3bb334195c09d47b21` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:50.781347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c4cbf4ccd34a3bb334195c09d47b21)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:50.783217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:50.945538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c4cbf4ccd34a3bb334195c09d47b21', 'request_id': 'req-510b2d91-6bc3-46cc-a4ff-984ad275470c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.024314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c4cbf4ccd34a3bb334195c09d47b21', 'request_id': 'req-510b2d91-6bc3-46cc-a4ff-984ad275470c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.031933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c4cbf4ccd34a3bb334195c09d47b21', 'request_id': 'req-510b2d91-6bc3-46cc-a4ff-984ad275470c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.044231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] The token cache is being invalidate because project 18c4cbf4ccd34a3bb334195c09d47b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:51.044521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.045239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.047050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1008/2006] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:50 2022] DELETE /identity/v3/projects/18c4cbf4ccd34a3bb334195c09d47b21 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:51.050869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:51.062187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4bcde-e670-4700-98f6-ac85ae3053e2 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:51.085623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:51.124980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:51.125959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:51.126319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:51.126670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] PATH_INFO: `/v3/users/bb5e30c3413d440896ae462b2427d3e0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:51.128112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5e30c3413d440896ae462b2427d3e0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:51.130139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:51.312663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5e30c3413d440896ae462b2427d3e0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.313247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5e30c3413d440896ae462b2427d3e0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.313858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5e30c3413d440896ae462b2427d3e0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.321702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5e30c3413d440896ae462b2427d3e0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.400347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5e30c3413d440896ae462b2427d3e0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:51.419684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 999/2007] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:51 2022] DELETE /identity/v3/users/bb5e30c3413d440896ae462b2427d3e0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:51.882749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:51.884289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:51.919943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2d91-6bc3-46cc-a4ff-984ad275470c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:51.983795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:51.984688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:51.984999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:51.985283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] PATH_INFO: `/v3/projects/d31056e3be0d423786ee8ea3c1956bc2` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:51.988215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31056e3be0d423786ee8ea3c1956bc2)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:51.990694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:52.006299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:52.140170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31056e3be0d423786ee8ea3c1956bc2', 'request_id': 'req-39e3d9ac-a725-47b4-a23e-a3344603b636'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.258049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31056e3be0d423786ee8ea3c1956bc2', 'request_id': 'req-39e3d9ac-a725-47b4-a23e-a3344603b636'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.265553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31056e3be0d423786ee8ea3c1956bc2', 'request_id': 'req-39e3d9ac-a725-47b4-a23e-a3344603b636'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.276743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] The token cache is being invalidate because project d31056e3be0d423786ee8ea3c1956bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:52.277060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.278264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.280659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1009/2008] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:51 2022] DELETE /identity/v3/projects/d31056e3be0d423786ee8ea3c1956bc2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:52.284562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:52.286092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:52.302783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565908-a565-47ac-95f6-725b8939eb88 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:52.367207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:52.368366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:52.368647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:52.368955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] PATH_INFO: `/v3/users/29fc291e214042ecaa1a1f73fcddc094` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:52.370177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fc291e214042ecaa1a1f73fcddc094)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:52.372219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:52.559991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:52.561987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fc291e214042ecaa1a1f73fcddc094'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.562761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fc291e214042ecaa1a1f73fcddc094'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.563471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fc291e214042ecaa1a1f73fcddc094'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.570684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fc291e214042ecaa1a1f73fcddc094'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.664065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fc291e214042ecaa1a1f73fcddc094'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:52.688920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1000/2009] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:52 2022] DELETE /identity/v3/users/29fc291e214042ecaa1a1f73fcddc094 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:53.152529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:53.154045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:53.217377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3d9ac-a725-47b4-a23e-a3344603b636 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:53.266363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:53.266902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.267188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.267467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.269299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:53.326089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:53.328665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:53.336836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:53.338681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22a3e-696b-40b4-9048-c740942fa813 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:53.350083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1010/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:53.430303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e95f0-f2d6-4017-9ebb-4e18481d4972 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:53.437394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:53.439320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.439945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.441075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] PATH_INFO: `/v3/projects/8280f45156e646cd9be114d6512bda40` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.442741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8280f45156e646cd9be114d6512bda40)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:53.445485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:53.567446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8280f45156e646cd9be114d6512bda40', 'request_id': 'req-6eafc061-c84a-4b59-bf9d-efc8038fcb09'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:53.669318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8280f45156e646cd9be114d6512bda40', 'request_id': 'req-6eafc061-c84a-4b59-bf9d-efc8038fcb09'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:53.676013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8280f45156e646cd9be114d6512bda40', 'request_id': 'req-6eafc061-c84a-4b59-bf9d-efc8038fcb09'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:53.686547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] The token cache is being invalidate because project 8280f45156e646cd9be114d6512bda40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:53.686840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:53.687478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6eafc061-c84a-4b59-bf9d-efc8038fcb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:53.689062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1001/2011] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:53 2022] DELETE /identity/v3/projects/8280f45156e646cd9be114d6512bda40 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:53.695463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.695463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.696030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.713281 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:53.720257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:53.721593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:53.781423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1011/2012] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:53.789758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.790053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.790333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.821420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:53.821420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:53.830749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1002/2013] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:53.831364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:53.845112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9514-9afe-45a5-87aa-c97d6e1af3ea None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:53.853906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:53.854699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.854848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.855127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.855949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:53.856423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:53.858452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:53.876434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1012/2014] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:59:53.881963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:53.893198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ce160-da29-4c3c-a82c-c8d7e3f696cd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:53.899008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:53.901633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:53.901633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:53.901633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:53.901633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:53.903245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.032913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1003/2015] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:53 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:54.037021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.047934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228221c3-d2a2-441d-829f-6c510ca8d40d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.111866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.112758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.113118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.113375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.114073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.116266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.243996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1013/2016] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:54 2022] POST /identity/v3/users => generated 281 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:54.245579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.261748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33ceb-074c-498d-bd16-e0c001e081e5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.267950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.268634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.268951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.269232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.270054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.271758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.302029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1004/2017] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:54.307251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.331772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6832be-c58f-4efa-ad59-2b02aa4539a2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.340783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.345424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.345424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.345424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.345424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.348510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5fe72-d50c-4436-b00a-597c53efaa1b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.366017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1014/2018] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:54.366905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.393922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e6bc-d909-464a-a366-f08597579c8a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.408101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.409124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.409458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.409738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] PATH_INFO: `/v3/projects/8fa93578cd7940218734dc675eb25892/users/3ce77b825384451ba77975e72affd066/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.422824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:54.427256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa93578cd7940218734dc675eb25892, user_id=3ce77b825384451ba77975e72affd066, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.430237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.528709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1005/2019] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:54 2022] PUT /identity/v3/projects/8fa93578cd7940218734dc675eb25892/users/3ce77b825384451ba77975e72affd066/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:54.539852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.540150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.540432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.570150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] MFA Rules not processed for user `3ce77b825384451ba77975e72affd066`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:54.571807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:54.640837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1015/2020] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:54.676171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.678473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:54.755682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc486662-6e1b-455f-b418-cf1e9f139744 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.761525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.762269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.762573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.762843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.776999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.776999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.788028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1006/2021] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:54.803396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.812055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:54.870049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0f047-8949-480a-b75e-23dfdb680f18 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.876774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.877728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.878010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.878285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] PATH_INFO: `/v3/users/3ce77b825384451ba77975e72affd066` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.879904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce77b825384451ba77975e72affd066)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.882285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:54.958290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:54.959834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:54.977067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ae01-3585-45a9-84ed-b72c797d3257 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:54.982565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:54.983461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:54.983746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:54.984028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] PATH_INFO: `/v3/users/ea86039e70904324ada4fd2cd9be754e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:54.985330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea86039e70904324ada4fd2cd9be754e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:54.987259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:55.054631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce77b825384451ba77975e72affd066'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.062228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce77b825384451ba77975e72affd066'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.062896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce77b825384451ba77975e72affd066'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.063513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce77b825384451ba77975e72affd066'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.160857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b1b7d817-a9d2-4127-93f6-13ddbd2eda7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce77b825384451ba77975e72affd066'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.179462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1016/2022] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:54 2022] DELETE /identity/v3/users/3ce77b825384451ba77975e72affd066 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:55.184385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.184716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.185056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.202167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:55.203232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea86039e70904324ada4fd2cd9be754e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.203382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.203879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea86039e70904324ada4fd2cd9be754e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.204486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea86039e70904324ada4fd2cd9be754e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.211806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea86039e70904324ada4fd2cd9be754e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.264408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1017/2023] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:55.274354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:55.275710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.286938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea86039e70904324ada4fd2cd9be754e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.303185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:55.306120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1007/2024] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 12:59:54 2022] DELETE /identity/v3/users/ea86039e70904324ada4fd2cd9be754e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:55.335007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea0a6-8c0f-4acb-81a1-1a70ad5c9097 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:55.386372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:55.387130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.387419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.387697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.450621 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:55.452446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44da22-defe-4481-a42a-6ffa40bb97e2 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:55.462414 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1018/2025] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:55.522706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:55.524371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.540398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f537-51fa-4e76-a0f0-2db225e2e5a6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:55.547422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:55.548492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.548658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.548971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] PATH_INFO: `/v3/projects/021e7f6d6c8c4ddd8851a1890b0d2bc7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.550202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021e7f6d6c8c4ddd8851a1890b0d2bc7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:55.552082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:55.711443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021e7f6d6c8c4ddd8851a1890b0d2bc7', 'request_id': 'req-f6e2279c-b99b-416a-b108-4abbf1aa2585'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.783728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021e7f6d6c8c4ddd8851a1890b0d2bc7', 'request_id': 'req-f6e2279c-b99b-416a-b108-4abbf1aa2585'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.786463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:55.791143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021e7f6d6c8c4ddd8851a1890b0d2bc7', 'request_id': 'req-f6e2279c-b99b-416a-b108-4abbf1aa2585'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.801619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] The token cache is being invalidate because project 021e7f6d6c8c4ddd8851a1890b0d2bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:55.801908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.802555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:55.804114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1008/2026] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:55 2022] DELETE /identity/v3/projects/021e7f6d6c8c4ddd8851a1890b0d2bc7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:55.809517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06467c-1220-45cb-b2ab-8a7d3e654b3d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.809818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06467c-1220-45cb-b2ab-8a7d3e654b3d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.810105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06467c-1220-45cb-b2ab-8a7d3e654b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.828098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-eb06467c-1220-45cb-b2ab-8a7d3e654b3d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:55.829324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-eb06467c-1220-45cb-b2ab-8a7d3e654b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.843121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:55.845210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.900608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1019/2027] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:55.910068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.910364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.910646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.918173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2279c-b99b-416a-b108-4abbf1aa2585 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:55.923562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:55.924438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.924755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.933024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] PATH_INFO: `/v3/projects/8fa93578cd7940218734dc675eb25892` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.933024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa93578cd7940218734dc675eb25892)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:55.933024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:55.933726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:55.933726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:55.943731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1020/2028] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:55.944438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:55.955152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0693c3-69a2-47e6-a931-0f020f11736e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:55.960386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:55.961016 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.961299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.961572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.962309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:55.962645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:55.964233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:55.977027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1021/2029] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:59:55.981424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:55.990927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960a63-4db7-40cf-9a31-d502fc891ab8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:55.995683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:55.996361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:55.996640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:55.996961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:55.997634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:55.999497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.003501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:56.070052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa93578cd7940218734dc675eb25892', 'request_id': 'req-f8272b6e-3d63-4da2-9914-728004c6802f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:56.117112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1022/2030] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:55 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:56.121688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.181294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d860cd8-db04-4ddf-a100-6874fc5c6a1f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.186609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.187222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.187506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.187784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.188504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.190442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.218033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa93578cd7940218734dc675eb25892', 'request_id': 'req-f8272b6e-3d63-4da2-9914-728004c6802f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:56.225056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa93578cd7940218734dc675eb25892', 'request_id': 'req-f8272b6e-3d63-4da2-9914-728004c6802f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:56.235828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] The token cache is being invalidate because project 8fa93578cd7940218734dc675eb25892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:59:56.236118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:56.236826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f8272b6e-3d63-4da2-9914-728004c6802f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:59:56.238400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1009/2031] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 12:59:55 2022] DELETE /identity/v3/projects/8fa93578cd7940218734dc675eb25892 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:56.243644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f320-19a4-4f91-bd98-7013d5ac5942 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.243938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f320-19a4-4f91-bd98-7013d5ac5942 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.249254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f320-19a4-4f91-bd98-7013d5ac5942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.263461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a989f320-19a4-4f91-bd98-7013d5ac5942 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:56.264764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a989f320-19a4-4f91-bd98-7013d5ac5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:56.273293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1010/2032] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:56.284927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07d45-c289-4993-a001-5a100249413d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.285285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07d45-c289-4993-a001-5a100249413d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.285640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07d45-c289-4993-a001-5a100249413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.304301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1023/2033] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:56.309155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.311808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:56.316562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d8a07d45-c289-4993-a001-5a100249413d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:56.317853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8a07d45-c289-4993-a001-5a100249413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:56.327245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a553a-4bba-4767-8a77-d185b0da35a6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.328246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1011/2034] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:56.333075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a07d45-c289-4993-a001-5a100249413d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.336994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.338072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.338360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.338639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.339382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.342031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.343742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a07d45-c289-4993-a001-5a100249413d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.348867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.349599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.349831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.350016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.350796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:59:56.351043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.352737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.358023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1024/2035] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:56.362524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.373008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1012/2036] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:59:56.376716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.381900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e664a-6152-41a4-85df-cbc76c3d1ec4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.388727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c230-39ba-4bc4-ad82-ff3035392254 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.396069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.396970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.397104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.397228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.397546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.398295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.398415 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.398512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.398857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.399828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.401170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.402698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.415370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1025/2037] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:56.420400 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.431164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b83d7-bc2e-4e44-be56-00e189d143ca admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.438685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.438685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.438685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.438685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] PATH_INFO: `/v3/projects/31f72098d6ff4c3db21952a3df3c6eaf/users/530fb849889d42f690140305499ef7e3/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.453693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f72098d6ff4c3db21952a3df3c6eaf, user_id=530fb849889d42f690140305499ef7e3, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.456539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1ab7b-8a2b-49c8-b0c8-f685e513031c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.519654 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1013/2038] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:59:56.520951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.538340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1026/2039] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:56 2022] PUT /identity/v3/projects/31f72098d6ff4c3db21952a3df3c6eaf/users/530fb849889d42f690140305499ef7e3/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:59:56.545991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.546282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.546563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.563696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:56.564936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:56.582977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d763-520b-4ac8-8a48-5ed9078c8339 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.626522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1027/2040] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:59:56.638011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.639543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:56.640472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.641190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.641482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.641763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.642498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.644447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.674529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:56.696927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bccf7a-f779-43fa-be57-9acd10e15ed8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.700908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.701570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.701872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.702146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.711441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.712908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.722647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1028/2041] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:59:56.764532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:56.769722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1014/2042] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 12:59:56 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:59:56.773797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.784083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a5ae-8e68-4390-b7ba-d3b8d8526796 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.788637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.789350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.796836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.796836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.796836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.796836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.803355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1029/2043] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 12:59:56.807186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.817600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd67f4-00e7-40f4-a804-86a857099253 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.822378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.823042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.823330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.825722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.825722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.826351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0173f32-2a48-4d91-b11c-d83a39bcc574 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.836647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1015/2044] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:59:56.841327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:56.851565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8f64d-30a9-4af3-998f-3c4e878c49c8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:56.857493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:56.858389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:56.858672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:56.858950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] PATH_INFO: `/v3/projects/fa974cc341444e67be4be2ea5211e930/users/e3b6df499bcb4e8daf375d43793eb42b/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:56.874531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa974cc341444e67be4be2ea5211e930, user_id=e3b6df499bcb4e8daf375d43793eb42b, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:56.877624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:56.992505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1030/2045] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 12:59:56 2022] PUT /identity/v3/projects/fa974cc341444e67be4be2ea5211e930/users/e3b6df499bcb4e8daf375d43793eb42b/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:59:57.002365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:57.002659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:57.002938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:57.061202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] MFA Rules not processed for user `e3b6df499bcb4e8daf375d43793eb42b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:57.062167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:57.138493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1016/2046] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:57.150389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:57.155670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:57.212466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc63a-5b50-4448-be1a-c8677d05fdaa admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:57.216965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:57.217647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:57.217930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:57.218204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:57.227318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:57.228967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cbf46-df31-43c0-93cf-ec4e247d4f95 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:57.238887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1031/2047] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:00.677293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:00.679968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:00.752492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:00.776763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f47e0-4b23-4778-83ff-1011b66bf203 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:00.784796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:00.786216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:00.787929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:00.788225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] PATH_INFO: `/v3/users/cf12b23e122143978def02ab947ffe14` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:00.791061 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf12b23e122143978def02ab947ffe14)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:00.793832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:01.018194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf12b23e122143978def02ab947ffe14'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:01.019055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf12b23e122143978def02ab947ffe14'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:01.019696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf12b23e122143978def02ab947ffe14'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:01.038644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf12b23e122143978def02ab947ffe14'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:01.098418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf12b23e122143978def02ab947ffe14'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:01.123489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1017/2048] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:00 2022] DELETE /identity/v3/users/cf12b23e122143978def02ab947ffe14 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:01.126909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:01.127811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:01.128291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:01.151611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:01.156557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:01.281680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1032/2049] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:01.295974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:01.298457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:01.391764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7725-6ea8-4d01-bfc3-92f151054581 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:01.396442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:01.397468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:01.398063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:01.398642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:01.410062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:01.411977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:01.428888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1018/2050] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:02.027952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:02.029609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:02.064323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d3300-1d88-4aa0-86ab-6990f966fab1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:02.081055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:02.081979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:02.083075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:02.083075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] PATH_INFO: `/v3/projects/2ac31cf2a25f4a51ac7b6271db49b99f` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:02.083977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac31cf2a25f4a51ac7b6271db49b99f)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:02.086119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:02.248218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:02.268137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac31cf2a25f4a51ac7b6271db49b99f', 'request_id': 'req-544a5dd2-50fb-403e-8e6c-78b50d5e837b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.356578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac31cf2a25f4a51ac7b6271db49b99f', 'request_id': 'req-544a5dd2-50fb-403e-8e6c-78b50d5e837b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.365883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac31cf2a25f4a51ac7b6271db49b99f', 'request_id': 'req-544a5dd2-50fb-403e-8e6c-78b50d5e837b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.381366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] The token cache is being invalidate because project 2ac31cf2a25f4a51ac7b6271db49b99f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:02.381656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.382342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-544a5dd2-50fb-403e-8e6c-78b50d5e837b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.384090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1033/2051] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:02 2022] DELETE /identity/v3/projects/2ac31cf2a25f4a51ac7b6271db49b99f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:02.388573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:02.400299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed369-2480-4e21-ac0b-e7ea23f3dbac service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:02.474702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:02.476053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:02.476437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:02.476926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] PATH_INFO: `/v3/users/224dfba1b39248dea6298af2de5bd743` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:02.478305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224dfba1b39248dea6298af2de5bd743)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:02.480933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:02.484022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90efe5-23b0-4321-a163-bb1e990c70fe None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:02.484313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90efe5-23b0-4321-a163-bb1e990c70fe None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:02.484643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90efe5-23b0-4321-a163-bb1e990c70fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:02.494725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:02.516160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ce90efe5-23b0-4321-a163-bb1e990c70fe None None] MFA Rules not processed for user `530fb849889d42f690140305499ef7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:02.517971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ce90efe5-23b0-4321-a163-bb1e990c70fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:02.585250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1034/2052] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:02.595788 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:02.596270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:02.596516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:02.617091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] MFA Rules not processed for user `530fb849889d42f690140305499ef7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:02.618582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:02.627230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1035/2053] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:02.638468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:02.640177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:02.718023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158f70-e785-4efc-8244-f3dc8167543b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:02.723859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:02.724377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:02.724932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:02.725049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:02.727548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224dfba1b39248dea6298af2de5bd743'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.728235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224dfba1b39248dea6298af2de5bd743'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.728844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224dfba1b39248dea6298af2de5bd743'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.734940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:02.736706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:02.736823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224dfba1b39248dea6298af2de5bd743'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.747658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1036/2054] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:02.826757 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c05ab3a-ad66-4c67-9284-2484bd25ee52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224dfba1b39248dea6298af2de5bd743'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:02.845710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1019/2055] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:02 2022] DELETE /identity/v3/users/224dfba1b39248dea6298af2de5bd743 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:00:03.474814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:03.477173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:03.495065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65376ed-6454-47a1-b888-108f1dba574d service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:03.537696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:03.570689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:03.571587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:03.571876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:03.572173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] PATH_INFO: `/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:03.573494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb5ee6c1b974fd4b2f7bc413beb170c)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:03.576033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:03.681723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b9c1-5c89-4388-a85f-caef84c2eef7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:03.682217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b9c1-5c89-4388-a85f-caef84c2eef7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:03.682665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b9c1-5c89-4388-a85f-caef84c2eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:03.707227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ba97b9c1-5c89-4388-a85f-caef84c2eef7 None None] MFA Rules not processed for user `530fb849889d42f690140305499ef7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:03.708536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ba97b9c1-5c89-4388-a85f-caef84c2eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:03.749635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb5ee6c1b974fd4b2f7bc413beb170c', 'request_id': 'req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:03.772004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1020/2056] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:03.863713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb5ee6c1b974fd4b2f7bc413beb170c', 'request_id': 'req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:03.870934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb5ee6c1b974fd4b2f7bc413beb170c', 'request_id': 'req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:03.881830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] The token cache is being invalidate because project 7eb5ee6c1b974fd4b2f7bc413beb170c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:03.882125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:03.882797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bb10921-fc41-4f8b-b506-3e974ed4d7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:03.884507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1037/2057] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:03 2022] DELETE /identity/v3/projects/7eb5ee6c1b974fd4b2f7bc413beb170c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:03.891456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:03.891742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:03.892045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:03.912260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:03.913547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:03.978807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1021/2058] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:03.989851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:03.990192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:03.990436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.034598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:04.035879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:04.051354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1038/2059] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:04.055836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.066300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006b7e-4df3-42de-b906-386c5043b653 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.071385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.072122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.072417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.072710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.073456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:04.073768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.076484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.092055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1022/2060] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:00:04.096300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.107420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbaad-8ac4-43a9-98b1-1d97046d27b3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.114370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.115113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.116096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.116096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.116728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.119000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.260275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1039/2061] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:04 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:04.265669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.275508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf809a2-57eb-4667-9115-8b7d8f3262fb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.289955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:04.353473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.359136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.363996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.364277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.365064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.367045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.541637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1023/2062] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:04 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:04.545903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.560709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791cc27-5814-419c-9f5b-a05ac6cf65bc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.578393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.579106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.582741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.582741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.582741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.594027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.634768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1040/2063] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:04.638489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.653888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef25b0-b723-4f1b-80f1-8ff7dd5a9ed7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.664833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.667329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.668583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.669126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.670862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.673327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27213fd9-1360-4b42-b984-55910d02e67d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.692221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1024/2064] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:04.693025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.704389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c0fa1-4d09-4986-b12e-1b429ecb6b7e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:04.709603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:04.710516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.710805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.711088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] PATH_INFO: `/v3/projects/73a19c599afc4e3d9ae93834c874e348/users/b827d70b64e54ab992bf9471dc99c669/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.743608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a19c599afc4e3d9ae93834c874e348, user_id=b827d70b64e54ab992bf9471dc99c669, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:04.743608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:04.848070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1041/2065] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:04 2022] PUT /identity/v3/projects/73a19c599afc4e3d9ae93834c874e348/users/b827d70b64e54ab992bf9471dc99c669/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:04.860771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:04.861093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:04.861378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:04.898351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] MFA Rules not processed for user `b827d70b64e54ab992bf9471dc99c669`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:04.899600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:04.975128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1025/2066] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:04.987026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:04.988842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:05.061722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c5662-c882-4d11-8402-ce7c40c495b3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:05.067161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:05.067832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:05.069308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:05.069308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:05.081692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:05.083502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5e5c-16fb-470f-b150-0bb36df5127d service glance] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:05.093935 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1042/2067] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:10.463303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:10.466706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:10.546383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8aa10-bd07-4939-8ed3-8e93e9920268 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:10.550898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:10.551803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:10.552088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:10.552363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] PATH_INFO: `/v3/users/7a075b995e9d4c558f5dce6edb696b2b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:10.553747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a075b995e9d4c558f5dce6edb696b2b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:10.555694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:10.643028 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:10.714229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a075b995e9d4c558f5dce6edb696b2b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:10.715102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a075b995e9d4c558f5dce6edb696b2b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:10.715726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a075b995e9d4c558f5dce6edb696b2b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:10.724870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a075b995e9d4c558f5dce6edb696b2b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:10.795305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a075b995e9d4c558f5dce6edb696b2b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:10.814171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1026/2068] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:10 2022] DELETE /identity/v3/users/7a075b995e9d4c558f5dce6edb696b2b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:10.818705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:10.819238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:10.819238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:10.825620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:10.837252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:10.838461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:10.903914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1043/2069] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:10.913534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:10.914962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:10.973185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcacdb-f7d8-4b65-ba06-02ac5b8dc3d3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:10.976936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:10.977591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:10.977879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:10.978155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:10.988086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:10.989574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ed3ab-5107-4a53-99fa-6851743d3b21 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:10.999941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1027/2070] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:11.431535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:11.433103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:11.446169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578192fc-3488-4ae9-8fc5-ba335ce967eb None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:11.452137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:11.453675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:11.453675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:11.453675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] PATH_INFO: `/v3/projects/8abe7ab1ba4e46c78c5755d3150d39f8` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:11.459142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abe7ab1ba4e46c78c5755d3150d39f8)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:11.459142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:11.562680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abe7ab1ba4e46c78c5755d3150d39f8', 'request_id': 'req-1e46cefc-bf22-4448-8958-d5a34a58ac9e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:11.623984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abe7ab1ba4e46c78c5755d3150d39f8', 'request_id': 'req-1e46cefc-bf22-4448-8958-d5a34a58ac9e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:11.632866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abe7ab1ba4e46c78c5755d3150d39f8', 'request_id': 'req-1e46cefc-bf22-4448-8958-d5a34a58ac9e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:11.645650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] The token cache is being invalidate because project 8abe7ab1ba4e46c78c5755d3150d39f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:11.645974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:11.646639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e46cefc-bf22-4448-8958-d5a34a58ac9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:11.648316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1044/2071] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:11 2022] DELETE /identity/v3/projects/8abe7ab1ba4e46c78c5755d3150d39f8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:11.654372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:11.654835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:11.654925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:11.672358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:11.673656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:11.732566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1028/2072] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:11.740248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:11.740546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:11.740870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:11.761172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:11.762415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:11.770566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1045/2073] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:11.774816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:11.785044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413f40-ffdf-4275-bb68-07c0ad72799f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:11.789584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:11.790242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:11.790529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:11.790810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:11.791545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:11.791864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:11.794394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:11.805741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1029/2074] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:11.810550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:11.820808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4474-d960-4332-92f4-37c256734968 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:11.825876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:11.826571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:11.826858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:11.827169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:11.827918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:11.830123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:11.933742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1046/2075] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:11.938004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:11.949197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330841a-252a-4211-bf79-63d53aa16437 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:11.984946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:12.025483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:12.028075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.028075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.028075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.030631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:12.034831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:12.156822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1030/2076] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:11 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:12.161190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:12.171387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19363532-3a9d-483e-bac2-6f065a43e1f2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:12.175791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:12.176446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.176833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.177111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.177842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:12.182820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:12.190255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1047/2077] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:00:12.195179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:12.208700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994b8b3-18fd-43f6-8722-5210d7db1b71 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:12.215182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:12.215875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.216267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.216549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.217337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:12.218947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886c24f-cf77-4a3d-8c2f-ce4d8623ca12 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:12.230256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1031/2078] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:00:12.234724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:12.245282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cd06-8de0-4958-9702-a158ea5ca5a5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:12.250164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:12.251074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.251366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.255940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] PATH_INFO: `/v3/projects/ec33d97d5de840dda27236650f132b32/users/4dd879476b8542d39c1ccf98316470cc/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.266839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec33d97d5de840dda27236650f132b32, user_id=4dd879476b8542d39c1ccf98316470cc, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:12.269616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:12.332513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1048/2079] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:12 2022] PUT /identity/v3/projects/ec33d97d5de840dda27236650f132b32/users/4dd879476b8542d39c1ccf98316470cc/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:12.344585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.344939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.345223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.373910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] MFA Rules not processed for user `4dd879476b8542d39c1ccf98316470cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:12.375157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:12.442418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1032/2080] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:12.453353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:12.455051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:12.486361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:12.518345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cd10-fd28-4a39-9506-d817a2f7d6a3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:12.522042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:12.522692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:12.522974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:12.523250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:12.533256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:12.534676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dcfe3-45f3-4edb-b25a-a3cbc74818e5 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:12.543916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1049/2081] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:20.753673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:20.755111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:20.827305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c3f99-cdc3-49bf-8e50-aee68989ee91 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:20.832264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:20.833138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:20.833418 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:20.833690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] PATH_INFO: `/v3/users/e3b6df499bcb4e8daf375d43793eb42b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:20.834936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b6df499bcb4e8daf375d43793eb42b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:20.836972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:21.046430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:21.047971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b6df499bcb4e8daf375d43793eb42b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:21.048626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b6df499bcb4e8daf375d43793eb42b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:21.049253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b6df499bcb4e8daf375d43793eb42b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:21.055887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b6df499bcb4e8daf375d43793eb42b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:21.125434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b6df499bcb4e8daf375d43793eb42b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:21.143620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1033/2082] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:20 2022] DELETE /identity/v3/users/e3b6df499bcb4e8daf375d43793eb42b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:21.148072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:21.148553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:21.148646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:21.166216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:21.167612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:21.233383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1050/2083] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:21.246450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:21.247940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:21.308736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b9d0-215a-43b0-a879-4edc24618d90 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:21.313019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:21.313752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:21.314036 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:21.314310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:21.327018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:21.328319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e7ec3-bfbc-4f5c-97f8-9c1885b97a2f service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:21.338438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1034/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:21.801302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:21.801302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:21.820464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5a61-c895-472e-b8fc-0f3ec254bdca None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:21.831254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:21.831254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:21.831254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:21.831254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] PATH_INFO: `/v3/projects/fa974cc341444e67be4be2ea5211e930` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:21.831915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa974cc341444e67be4be2ea5211e930)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:21.834494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:21.963526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa974cc341444e67be4be2ea5211e930', 'request_id': 'req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:22.072623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa974cc341444e67be4be2ea5211e930', 'request_id': 'req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:22.082824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa974cc341444e67be4be2ea5211e930', 'request_id': 'req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:22.096617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] The token cache is being invalidate because project fa974cc341444e67be4be2ea5211e930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:22.096977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:22.097954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-de6f7f96-8b07-4e76-aa6f-860c8096cdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:22.100256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1051/2085] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:21 2022] DELETE /identity/v3/projects/fa974cc341444e67be4be2ea5211e930 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:22.106472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.106472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.106472 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.125513 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:22.126775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:22.187178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1035/2086] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:22.196230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.196739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.196844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.215074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:22.216283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:22.224265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1052/2087] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:22.228413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.238948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573d52-69a4-4165-b261-cb83fa18bba7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.244786 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.246694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.246980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.247261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.247997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:22.248307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.249928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.262099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1036/2088] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:22.267059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.275990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3be0-0eb0-4b71-ad05-059e3c89c0ce None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.281698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.282367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.282654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.282929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.283623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.285570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.374135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1053/2089] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:22 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:22.378351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.388330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e431e7-3014-44fd-a886-66f390b692b5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.435518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:22.444172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.444888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.445174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.445454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.446140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.448049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.564278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1037/2090] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:22 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:22.565579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.576363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705321-6b26-480e-94ed-41e52f0c6c9f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.581033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.581727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.582015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.582314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.583060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.584774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.596261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1054/2091] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:00:22.600302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.611192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685904-0429-466b-936b-4db92a1863cb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.616342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.617053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.617347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.617634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.618636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.620310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937e2b6-59c7-471c-84fc-01d03e8667b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.632780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1038/2092] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:22.637115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.647603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a5d8-abd0-4cdb-af5c-149631107379 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.653011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.653922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.654211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.654509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] PATH_INFO: `/v3/projects/03fa76914d444bc193f74afa7ac48db4/users/d69534c4dbe24ffc82032ecb4e2851a2/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.657670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:22.669361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fa76914d444bc193f74afa7ac48db4, user_id=d69534c4dbe24ffc82032ecb4e2851a2, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.672022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.743231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1055/2093] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:22 2022] PUT /identity/v3/projects/03fa76914d444bc193f74afa7ac48db4/users/d69534c4dbe24ffc82032ecb4e2851a2/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:22.753512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.754003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.754112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.781000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] MFA Rules not processed for user `d69534c4dbe24ffc82032ecb4e2851a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:22.782216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:22.845824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1039/2094] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:22.857748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:22.859484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:22.919741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a70a-20b3-4885-9111-465d65bdc084 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:22.923765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:22.924412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:22.924717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:22.924999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:22.933528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:22.934997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b2b7-ed3d-4a87-8863-d7a1457ecc46 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:22.943832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1056/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:29.803016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:29.804492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:29.871398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52442b5-a46f-4553-b4f0-e463f0222673 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:29.875970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:29.876889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:29.877172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:29.877446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] PATH_INFO: `/v3/users/4dd879476b8542d39c1ccf98316470cc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:29.878940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd879476b8542d39c1ccf98316470cc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:29.880537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:30.049050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd879476b8542d39c1ccf98316470cc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:30.049719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd879476b8542d39c1ccf98316470cc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:30.050366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd879476b8542d39c1ccf98316470cc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:30.058869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd879476b8542d39c1ccf98316470cc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:30.160765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd879476b8542d39c1ccf98316470cc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:30.162183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:30.179152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1040/2096] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:29 2022] DELETE /identity/v3/users/4dd879476b8542d39c1ccf98316470cc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:30.183800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:30.184295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:30.184419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:30.202134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:30.203322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:30.263246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1057/2097] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:30.272861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:30.274315 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:30.335321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df1b6-0d9e-4d84-a5e7-632c7e269ec9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:30.339913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:30.345283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:30.345283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:30.345283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:30.350599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:30.352470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434dba-ed9b-4abd-98c0-e346ce41476c service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:30.363236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1041/2098] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:30.852597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:30.855502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:30.871676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c364-2ed8-4480-b909-e3301aeccae4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:30.876564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:30.877499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:30.877836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:30.878116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] PATH_INFO: `/v3/projects/ec33d97d5de840dda27236650f132b32` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:30.879326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec33d97d5de840dda27236650f132b32)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:30.881288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:30.995638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec33d97d5de840dda27236650f132b32', 'request_id': 'req-af949bc8-09c6-44a1-b483-85c29a12a2f1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:31.103140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec33d97d5de840dda27236650f132b32', 'request_id': 'req-af949bc8-09c6-44a1-b483-85c29a12a2f1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:31.110145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec33d97d5de840dda27236650f132b32', 'request_id': 'req-af949bc8-09c6-44a1-b483-85c29a12a2f1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:31.121003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] The token cache is being invalidate because project ec33d97d5de840dda27236650f132b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:31.121292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:31.121925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-af949bc8-09c6-44a1-b483-85c29a12a2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:31.123465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1058/2099] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:30 2022] DELETE /identity/v3/projects/ec33d97d5de840dda27236650f132b32 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:31.128765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.129244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.129336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.147380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:31.148661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:31.210496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1042/2100] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:31.219145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.219670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.219913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.238637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:31.240085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:31.252359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1059/2101] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:31.253743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.268937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a915e-36fb-4c4b-8187-8767011a70b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.273956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.274880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.275168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.275448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.276874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:31.277183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.278970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.291128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1043/2102] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:00:31.295531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.301829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:31.317214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553915-828d-43d2-8ac4-2f12e16f916f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.327129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.327815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.328104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.328384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.329152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.331058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.421567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1060/2103] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:31.426704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.439276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa381f-4c56-4555-b13a-6aef656ad605 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.505983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.509114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.509114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.509114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.509114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.510112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.591958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:31.597909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1044/2104] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:31 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:31.603224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.614751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd6ba-49ef-4269-9e12-4ad9696c7ce2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.619910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.620647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.620965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.621366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.622109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.623863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.634474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1061/2105] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:31.639171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.649357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf5987-079c-4ec3-ac4f-06ba08913849 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.657793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.657793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.657793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.657793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.658205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.658435 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19310401-6170-429e-8e54-429fc4c645af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.669956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1045/2106] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:31.674816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.687350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faabb-4328-4ee8-8501-dcb10c52b5ee admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.693654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.695255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.695541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.695821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] PATH_INFO: `/v3/projects/ea071663174f44d488b6fd706ece6653/users/c1ede724f1e44fc5a0544338c3a49584/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.718186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea071663174f44d488b6fd706ece6653, user_id=c1ede724f1e44fc5a0544338c3a49584, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.720937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.773024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1062/2107] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:31 2022] PUT /identity/v3/projects/ea071663174f44d488b6fd706ece6653/users/c1ede724f1e44fc5a0544338c3a49584/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:00:31.779029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.779414 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.779605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.797620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:31.798863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:31.880436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1046/2108] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:31.892059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:31.893924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:31.961322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947f94-e0a9-4083-9f32-7e512909acfd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:31.966480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:31.967131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:31.967416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:31.967695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:31.979363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:31.984127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec70c2-258d-4acc-848a-fb0deaec08b8 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:31.991097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1063/2109] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:32.065202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:32.066642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:32.079500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51483615-c585-4a9f-abe0-5a7687c8da5f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:32.084508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:32.085447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:32.085739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:32.086020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] PATH_INFO: `/v3/users/b827d70b64e54ab992bf9471dc99c669` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:32.087247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b827d70b64e54ab992bf9471dc99c669)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:32.089244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:32.255175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b827d70b64e54ab992bf9471dc99c669'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:32.255862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b827d70b64e54ab992bf9471dc99c669'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:32.265338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b827d70b64e54ab992bf9471dc99c669'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:32.273333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b827d70b64e54ab992bf9471dc99c669'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:32.348759 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b827d70b64e54ab992bf9471dc99c669'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:32.371666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1047/2110] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:32 2022] DELETE /identity/v3/users/b827d70b64e54ab992bf9471dc99c669 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:32.376209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:32.376778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:32.380165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:32.394761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:32.395984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:32.464651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1064/2111] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:32.474188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:32.475907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:32.538801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b66c-f060-47b0-889b-1e0a2c82f297 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:32.543829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:32.544507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:32.544850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:32.545127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:32.555954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:32.558685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9ee6-489c-41b7-aca1-31c9b03308fc service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:32.570219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1048/2112] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:33.032478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.034337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:33.055177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b133a-dc3a-4d8e-9d84-5059bd4530e6 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.061087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.063924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.063924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.063924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] PATH_INFO: `/v3/projects/73a19c599afc4e3d9ae93834c874e348` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.063924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a19c599afc4e3d9ae93834c874e348)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.066008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.246106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:33.249038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a19c599afc4e3d9ae93834c874e348', 'request_id': 'req-010e4256-05e1-4261-9331-0690697d582f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:33.331423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a19c599afc4e3d9ae93834c874e348', 'request_id': 'req-010e4256-05e1-4261-9331-0690697d582f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:33.344194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a19c599afc4e3d9ae93834c874e348', 'request_id': 'req-010e4256-05e1-4261-9331-0690697d582f'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:33.359046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] The token cache is being invalidate because project 73a19c599afc4e3d9ae93834c874e348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:33.359343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:33.360009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-010e4256-05e1-4261-9331-0690697d582f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:33.361853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1065/2113] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:33 2022] DELETE /identity/v3/projects/73a19c599afc4e3d9ae93834c874e348 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:33.366582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.367086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.367168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.374951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:33.386447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:33.387767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:33.459620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1049/2114] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:33.468600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.469159 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.469300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.487841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:33.489306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:33.498170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1066/2115] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:33.502398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.512471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c788e-ab41-48b9-9e1c-bb7ed6a22106 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.517289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.517970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.518270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.518557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.519305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:33.519617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.521266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.534251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1050/2116] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:33.539533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.549907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515acd8-4da8-4c67-9552-82204b41c9f4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.554917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.555599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.555887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.556168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.556900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.559698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.668844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1067/2117] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:33 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:33.673134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.687032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8207f-8346-4fac-b20f-49dfe02fb6ae admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.755431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.756787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.757080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.757360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.758066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.760043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.850058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1051/2118] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:33 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:33.853648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.884198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f629b-1be1-4374-b55a-309215281168 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.888202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.888928 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.889210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.889485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.890227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.891821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.904842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1068/2119] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:00:33.907171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.918795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb96a0-d24d-43e3-965e-c9826b3c32f2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.923269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.923974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.924261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.924631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:33.925433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:33.927044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb61f4-797c-4dd5-b36f-adc7dc8b0d3b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:33.948337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1052/2120] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:33.955832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:33.966443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa667-ef41-4638-b084-15c80e3b6388 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:33.974204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:33.975170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:33.975637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:33.975975 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] PATH_INFO: `/v3/projects/bbece33978094ca9bb81fa3337658c12/users/ce66bd492ea84d0dbadb67d106990a44/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:34.006684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbece33978094ca9bb81fa3337658c12, user_id=ce66bd492ea84d0dbadb67d106990a44, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:34.010431 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:34.129074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1069/2121] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:33 2022] PUT /identity/v3/projects/bbece33978094ca9bb81fa3337658c12/users/ce66bd492ea84d0dbadb67d106990a44/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:34.140601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a549-6711-4cd4-9048-6c356b6ac3be None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:34.141196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a549-6711-4cd4-9048-6c356b6ac3be None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:34.141675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a549-6711-4cd4-9048-6c356b6ac3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:34.172333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-10e5a549-6711-4cd4-9048-6c356b6ac3be None None] MFA Rules not processed for user `ce66bd492ea84d0dbadb67d106990a44`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:34.173693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-10e5a549-6711-4cd4-9048-6c356b6ac3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:34.251302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:34.258917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1053/2122] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:34.268116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:34.277338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:34.344560 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecd44-eadf-4be4-ac95-c0b4e0c88e3c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:34.350500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:34.351566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:34.352140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:34.352588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:34.365633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:34.367162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:34.387658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1070/2123] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:37.934347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:37.934906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:37.934906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:37.983993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] MFA Rules not processed for user `c1ede724f1e44fc5a0544338c3a49584`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:37.983993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:38.090557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1054/2124] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:38.097019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.099275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:38.206331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:38.267012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae774-6897-44a8-b99e-77661e4783ab service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.273995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.274677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.274965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.275247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.277066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.279323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.394528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1071/2125] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:38 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:38.398678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.432953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c03958-9879-48b1-bdf5-a192347f2d9e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.518504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.519350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.519637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.525765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.526736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.528752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.635043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1055/2126] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:38 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:38.639262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.650138 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072774-a043-47e5-984c-ee89e8195746 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.655544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.665332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.665332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.665332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.665332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.666703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.685158 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1072/2127] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:38.693571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.707782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b69da-4ff6-4a91-9235-2ce167e82cf9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.713720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.714796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.715190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.715577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] PATH_INFO: `/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5/users/0a2525d45cd34901aedd2ab89c4a57aa/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.738053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e82dffe53b4a06ac3a8a7b81aaabe5, user_id=0a2525d45cd34901aedd2ab89c4a57aa, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.740785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.825155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1056/2128] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:38 2022] PUT /identity/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5/users/0a2525d45cd34901aedd2ab89c4a57aa/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:38.829234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.840491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a2c3-acc0-4505-9eca-5b020aed44f0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.907319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.908083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.908366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.908650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.909498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.911137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.923598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1073/2129] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:38.928056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:38.939422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdcea0-2039-4cf6-a4a4-b702d65c29c8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:38.947226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:38.949112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:38.949602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:38.950027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] PATH_INFO: `/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5/users/0a2525d45cd34901aedd2ab89c4a57aa/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:38.952338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e82dffe53b4a06ac3a8a7b81aaabe5, user_id=0a2525d45cd34901aedd2ab89c4a57aa, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:38.955725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d013c-142b-4e35-a954-0f023b8ef5a1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:38.968335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1057/2130] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:38 2022] PUT /identity/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5/users/0a2525d45cd34901aedd2ab89c4a57aa/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:39.985522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:40.017492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203c0d-666d-4d3e-8bf5-358c6deb659a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:40.105232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:40.106466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:40.109945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:40.110434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] PATH_INFO: `/v3/users/ce66bd492ea84d0dbadb67d106990a44` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:40.111914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce66bd492ea84d0dbadb67d106990a44)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:40.114387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:40.154864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:40.367314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce66bd492ea84d0dbadb67d106990a44'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:40.384190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce66bd492ea84d0dbadb67d106990a44'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:40.386782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce66bd492ea84d0dbadb67d106990a44'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:40.387586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce66bd492ea84d0dbadb67d106990a44'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:40.480577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce66bd492ea84d0dbadb67d106990a44'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:40.508432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1074/2131] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:39 2022] DELETE /identity/v3/users/ce66bd492ea84d0dbadb67d106990a44 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:40.511778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:40.512574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:40.513053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:40.551017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:40.552278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:40.566294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:40.636500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1058/2132] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:40.647901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:40.650610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:40.836766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ffa-a245-4c63-8a4c-44f259d74bc9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:40.842997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:40.843681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:40.844027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:40.844398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:40.855858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:40.866694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86be6c-a99e-48ae-bcd2-d405ba1cd1d0 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:40.902750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1075/2133] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:41.455580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:41.457522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:41.473897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b7fa8-7dd4-429b-9b6e-06c37ac97255 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:41.479216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:41.480788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:41.481250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:41.483627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] PATH_INFO: `/v3/projects/bbece33978094ca9bb81fa3337658c12` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:41.483627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbece33978094ca9bb81fa3337658c12)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:41.485661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:41.627615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbece33978094ca9bb81fa3337658c12', 'request_id': 'req-2c114c21-b0c3-4d99-bc0e-9d438db54570'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:41.740249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbece33978094ca9bb81fa3337658c12', 'request_id': 'req-2c114c21-b0c3-4d99-bc0e-9d438db54570'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:41.758781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbece33978094ca9bb81fa3337658c12', 'request_id': 'req-2c114c21-b0c3-4d99-bc0e-9d438db54570'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:41.778735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] The token cache is being invalidate because project bbece33978094ca9bb81fa3337658c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:41.779097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:41.779834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c114c21-b0c3-4d99-bc0e-9d438db54570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:41.781968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1059/2134] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:41 2022] DELETE /identity/v3/projects/bbece33978094ca9bb81fa3337658c12 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:41.787122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:41.787570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:41.787810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:41.860289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:41.865459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:41.930503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:41.953175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1076/2135] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:41.954613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:41.954912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:41.955203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:41.974840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:41.976104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:41.985505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1060/2136] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:41.989536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.000604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb18e1-9137-4eb6-a0c6-94abe1c7e446 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.005496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.006198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.006487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.006790 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.007575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:42.007890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.009586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.022945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1077/2137] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:42.027433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.037364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc64c8-dd7c-4b27-83f0-86193542b6f5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.042850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.043617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.043986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.044350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.045212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.047142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.134541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1061/2138] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:42 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:42.139377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.149366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa4b3-6625-4898-b0ee-723b9652512c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.209381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.210071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.210391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.210638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.211385 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.214102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.270458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1078/2139] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:42 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:42.274681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.292944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e54b4-3759-4fd9-9197-40c107187ebc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.298639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.300579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.300911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.301190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.302182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.303992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.317588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1062/2140] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:42.321721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.334347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c096-091b-4a26-a6d3-c0eefb0ed5cd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.342763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.343571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.343929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.345131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.345382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.350189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6853a-5ebb-4c08-b7a0-67d4f60aef43 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.377196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1079/2141] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:00:42.381334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.397936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b12eea-a296-4150-80cb-dccdcd2ac5f6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.403140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.404249 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.404447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.404834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] PATH_INFO: `/v3/projects/1e6949ef295b410fbceb1e1ffd064512/users/8f6142b570b043c4996624a980c2da8d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.424720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6949ef295b410fbceb1e1ffd064512, user_id=8f6142b570b043c4996624a980c2da8d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.425228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.500474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1063/2142] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:42 2022] PUT /identity/v3/projects/1e6949ef295b410fbceb1e1ffd064512/users/8f6142b570b043c4996624a980c2da8d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:42.505585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373369-248d-4e5a-bcac-c5e8c7165c41 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.505821 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373369-248d-4e5a-bcac-c5e8c7165c41 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.506108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373369-248d-4e5a-bcac-c5e8c7165c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.533012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ac373369-248d-4e5a-bcac-c5e8c7165c41 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:42.533012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ac373369-248d-4e5a-bcac-c5e8c7165c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:42.618926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1080/2143] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:42.620531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:42.623333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:42.702905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:42.722895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667af10-eec1-4bc9-88aa-273a0218ca4d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:42.728959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:42.730124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:42.730681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:42.731235 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:42.744092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:42.746267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:42.768308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1064/2144] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:00:44.307776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d65a2-e828-4bc7-915a-342f9cca91df None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:44.308511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d65a2-e828-4bc7-915a-342f9cca91df None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:44.308511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d65a2-e828-4bc7-915a-342f9cca91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:44.342189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f13d65a2-e828-4bc7-915a-342f9cca91df None None] MFA Rules not processed for user `8f6142b570b043c4996624a980c2da8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:44.342336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f13d65a2-e828-4bc7-915a-342f9cca91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:44.445403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:44.478595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1081/2145] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:44.485793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:44.487397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:44.573842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae30d3-bc95-4438-92bb-12987a628410 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:44.579543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:44.580219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:44.580512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:44.581009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:44.592245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:44.598834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:44.608809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1065/2146] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:45.220174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1709-c8e8-4146-917b-6357f2b1cc72 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:45.220462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1709-c8e8-4146-917b-6357f2b1cc72 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:45.220780 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1709-c8e8-4146-917b-6357f2b1cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:45.252639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cb5c1709-c8e8-4146-917b-6357f2b1cc72 None None] MFA Rules not processed for user `0a2525d45cd34901aedd2ab89c4a57aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:45.254188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cb5c1709-c8e8-4146-917b-6357f2b1cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:45.351872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1082/2147] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:45.366725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:45.368459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:45.447232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a097-9b88-4827-bbeb-6cad2f68b324 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:45.451530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:45.452197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:45.452484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:45.452794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:45.454646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:45.526282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:45.528002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:45.537403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1066/2148] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:45.841242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899f52-53b5-49de-8b21-e346daf4b566 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:45.841622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899f52-53b5-49de-8b21-e346daf4b566 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:45.841946 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899f52-53b5-49de-8b21-e346daf4b566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:45.862902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-67899f52-53b5-49de-8b21-e346daf4b566 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:45.864119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-67899f52-53b5-49de-8b21-e346daf4b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:45.924344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1083/2149] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:45.970842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:45.973258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:46.048843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:46.080040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d598c-b44f-4730-89ee-a0ad5a3d48c8 service glance] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:46.092490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:46.093040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:46.094332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:46.094772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:46.104878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:46.106508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50951050-513e-488a-acc3-a4451a3b67a4 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:46.116838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1067/2150] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:00:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:00:47.657608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b3cf-4065-484c-8d30-7515fdb50193 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:47.658222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b3cf-4065-484c-8d30-7515fdb50193 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:47.658222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b3cf-4065-484c-8d30-7515fdb50193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:47.694037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d2e9b3cf-4065-484c-8d30-7515fdb50193 None None] MFA Rules not processed for user `8f6142b570b043c4996624a980c2da8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:47.698527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d2e9b3cf-4065-484c-8d30-7515fdb50193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:47.708646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1084/2151] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:56.111733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=15 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:57.687947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=67 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:57.917853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.918335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.922553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.936608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] MFA Rules not processed for user `c1ede724f1e44fc5a0544338c3a49584`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:57.937890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.944901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1068/2152] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:03.232661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.233151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.233279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.266507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:03.267760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:03.284343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1085/2153] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:03.297190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:03.309646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973caa6c-f8ac-41ad-92ba-b49196f08138 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:03.314869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:03.315632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.315954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.316230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.326029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:03.327685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21576-c38d-446e-9d36-95c7e4085b82 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:03.335864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1069/2154] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:01:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:12.980952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:12.982699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.999931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bc707-3251-48f3-b04b-76c40ed2ef8c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:13.004496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:13.005427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.005716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.006023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] PATH_INFO: `/v3/users/d69534c4dbe24ffc82032ecb4e2851a2` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.007276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69534c4dbe24ffc82032ecb4e2851a2)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.009487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:13.332570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=9 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:13.342025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69534c4dbe24ffc82032ecb4e2851a2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:13.350180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69534c4dbe24ffc82032ecb4e2851a2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:13.350937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69534c4dbe24ffc82032ecb4e2851a2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:13.351557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69534c4dbe24ffc82032ecb4e2851a2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:13.433349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69534c4dbe24ffc82032ecb4e2851a2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:13.456939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1086/2155] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:12 2022] DELETE /identity/v3/users/d69534c4dbe24ffc82032ecb4e2851a2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:13.461343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.461710 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.462024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.480628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:13.482769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.547455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1070/2156] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.559834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:13.561325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.624157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90ce3-8b5e-44f5-928e-c035e54ffd1e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:13.627647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:13.628290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.628600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.628907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.638479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.639906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214a742-0036-4cde-ab58-caafd1282153 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:13.649811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1087/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:14.138975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.140520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:14.162316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b040-816f-42eb-b9c1-eed93b3a3bcb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.167770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.169142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.169142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.169407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] PATH_INFO: `/v3/projects/03fa76914d444bc193f74afa7ac48db4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.170615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fa76914d444bc193f74afa7ac48db4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.172769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.349321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fa76914d444bc193f74afa7ac48db4', 'request_id': 'req-8d7bef06-7364-4623-bff5-b4e06e690787'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:14.423689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fa76914d444bc193f74afa7ac48db4', 'request_id': 'req-8d7bef06-7364-4623-bff5-b4e06e690787'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:14.431588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fa76914d444bc193f74afa7ac48db4', 'request_id': 'req-8d7bef06-7364-4623-bff5-b4e06e690787'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:14.462541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] The token cache is being invalidate because project 03fa76914d444bc193f74afa7ac48db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:14.462831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:14.463521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d7bef06-7364-4623-bff5-b4e06e690787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:14.465164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1071/2158] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:14 2022] DELETE /identity/v3/projects/03fa76914d444bc193f74afa7ac48db4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:14.470090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.470555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.470656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.499673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:14.501010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:14.564036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:14.583986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1088/2159] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:14.592131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.592474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.592778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.611259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:14.612480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:14.621506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1072/2160] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:14.625646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.636447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacfdb-a105-4d52-811b-ba13408fa1f4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.641093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.641779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.642065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.642348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.643084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:14.643395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.645054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.658080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1089/2161] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:14.662700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.672398 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60c07-6217-4a84-81f0-f271502ca7bd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.677188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.677845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.678134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.678413 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.679151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.681820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.784748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1073/2162] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:14.788200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.798435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd86b8-b717-45ed-b01e-ff90a91df969 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.855684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.856367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.856656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.856965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.857657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.859570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.943108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1090/2163] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:14.947027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.957471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb464-6812-4569-8b99-81bf4c3baf01 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.964181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.964181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.964181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.964181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.964587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.966143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.976853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1074/2164] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:14.981396 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.992208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8817-e0d9-42df-9700-a1d01185bd1f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.004513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.004513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.004513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.004513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.004973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.004973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700639-89a1-4297-890c-7f13f839ba20 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.013730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1091/2165] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:15.017823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.028320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23b67d-eeb6-4ac2-ab17-adae71a8e46a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.033059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.033949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.034236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.034531 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] PATH_INFO: `/v3/projects/21d440dd7f294d17a3e06a07d1b15136/users/37b177053fd147afbc484ecef175860e/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.049843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d440dd7f294d17a3e06a07d1b15136, user_id=37b177053fd147afbc484ecef175860e, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.052538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.189392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1075/2166] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:15 2022] PUT /identity/v3/projects/21d440dd7f294d17a3e06a07d1b15136/users/37b177053fd147afbc484ecef175860e/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:15.193486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.193714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.193991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.222558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] MFA Rules not processed for user `37b177053fd147afbc484ecef175860e`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.223770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.292094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1092/2167] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.303231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.305607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.329613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:15.385645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cde45-4883-4965-985b-f89bfcd94de7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.389958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.390606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.390888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.391164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.400165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.401633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1018f-4636-440c-a0a1-4c2399ed1270 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.410378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1076/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:15.436630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.484202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:15.511200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4e0e-96dd-4c26-b992-48888e0c0b16 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.512056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.512977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.513258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.513535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] PATH_INFO: `/v3/users/37b177053fd147afbc484ecef175860e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.514771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b177053fd147afbc484ecef175860e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.516701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.739049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b177053fd147afbc484ecef175860e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:15.746564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b177053fd147afbc484ecef175860e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:15.747222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b177053fd147afbc484ecef175860e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:15.747822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b177053fd147afbc484ecef175860e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:15.838997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b177053fd147afbc484ecef175860e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:15.857736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1093/2169] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:15 2022] DELETE /identity/v3/users/37b177053fd147afbc484ecef175860e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:15.862252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.862541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.862821 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.882200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.883464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.940464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1077/2170] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.950302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.951696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:16.009763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635161d8-f0f2-4229-aaae-9a1d557a1040 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.013305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.013964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.014299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.014734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.024618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.026635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.035927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1094/2171] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:16.461174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.462948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:16.474846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd059-45a1-4ada-9aec-53a3b64787ce None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.481718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.482222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.482565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.482844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] PATH_INFO: `/v3/projects/21d440dd7f294d17a3e06a07d1b15136` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.484108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d440dd7f294d17a3e06a07d1b15136)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.486368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.599192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d440dd7f294d17a3e06a07d1b15136', 'request_id': 'req-d092a15b-3358-484c-8215-79fd77d68ccc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:16.679041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d440dd7f294d17a3e06a07d1b15136', 'request_id': 'req-d092a15b-3358-484c-8215-79fd77d68ccc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:16.692421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d440dd7f294d17a3e06a07d1b15136', 'request_id': 'req-d092a15b-3358-484c-8215-79fd77d68ccc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:16.707722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] The token cache is being invalidate because project 21d440dd7f294d17a3e06a07d1b15136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:16.708127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:16.708870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d092a15b-3358-484c-8215-79fd77d68ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:16.710713 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1078/2172] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:16 2022] DELETE /identity/v3/projects/21d440dd7f294d17a3e06a07d1b15136 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:26.031604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:26.704429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:41.201723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.203361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.321211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e262afb-f7af-475a-bdc2-5b79d6da2c11 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.390896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.391688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.392725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.392725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.395567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.409277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.410991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.422172 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1095/2173] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:41.922558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44e82-474b-4877-9a4b-be649351457a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.923111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44e82-474b-4877-9a4b-be649351457a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.923222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44e82-474b-4877-9a4b-be649351457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.942230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-31a44e82-474b-4877-9a4b-be649351457a None None] MFA Rules not processed for user `b75999cf46b744d2b5623c5615db2401`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:41.943555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-31a44e82-474b-4877-9a4b-be649351457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.002736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1079/2174] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:49.153338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:49.154868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:49.227393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbf7bc-12f2-41ca-861f-4f7acd8b2ac3 service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:49.231360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:49.232025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:49.232314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:49.232598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:49.234607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:49.275420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:49.313693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:49.315122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:49.325652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1096/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:50.042432 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b75fc-ec67-4eb8-bcd0-b2ceaf27f1d7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:50.042931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b75fc-ec67-4eb8-bcd0-b2ceaf27f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:50.043437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b75fc-ec67-4eb8-bcd0-b2ceaf27f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:50.110634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d64b75fc-ec67-4eb8-bcd0-b2ceaf27f1d7 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:50.112149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d64b75fc-ec67-4eb8-bcd0-b2ceaf27f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:50.223421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1080/2176] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:50.251628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:50.252200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:50.378060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da36f-f9cd-4b09-8459-f97e5d307b5a service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:50.386489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:50.387308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:50.387445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:50.388272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:50.397552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:50.399673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1dcc6-c4d5-4dc4-adaf-a2e89eb20f15 service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:50.418726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1097/2177] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:54.316789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.318560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.319420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.343856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] MFA Rules not processed for user `530fb849889d42f690140305499ef7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:54.345372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:54.416484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1081/2178] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:01:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:00.406809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=58 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:02.182906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a45-a342-4dd0-9848-cddf8350ad93 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:02.183774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a45-a342-4dd0-9848-cddf8350ad93 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:02.183774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a45-a342-4dd0-9848-cddf8350ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:02.235531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2ad63a45-a342-4dd0-9848-cddf8350ad93 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:02.238189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2ad63a45-a342-4dd0-9848-cddf8350ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:02.334707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1098/2179] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:02.359588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:02.361560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:02.400440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:02.560896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce5ed-8e04-4c29-b2ea-863a722586f2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:02.571898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:02.572863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:02.573412 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:02.573941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:02.588652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:02.590686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:02.605295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1082/2180] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:09.553289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f74a-4622-4212-8341-a1cecf7151cb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:09.553866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f74a-4622-4212-8341-a1cecf7151cb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:09.553866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f74a-4622-4212-8341-a1cecf7151cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:09.582093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ee93f74a-4622-4212-8341-a1cecf7151cb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:09.583327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ee93f74a-4622-4212-8341-a1cecf7151cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:09.591976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1099/2181] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:09.614110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:09.615660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:09.630325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448b04-547c-4192-88f6-2294741feb18 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:09.636735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:09.637528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:09.637932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:09.638211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:09.648133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:09.649738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:09.659162 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1083/2182] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:17.403228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbc3e-2106-4cf3-975e-e130d027f5b1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:17.403879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbc3e-2106-4cf3-975e-e130d027f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:17.403879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbc3e-2106-4cf3-975e-e130d027f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:17.421598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-69cdbc3e-2106-4cf3-975e-e130d027f5b1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:17.422795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-69cdbc3e-2106-4cf3-975e-e130d027f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:17.431141 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1100/2183] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:17.466202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:17.477984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960597b2-60a4-4f89-b3ba-943a743cba7b service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:17.483794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:17.484449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:17.485816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:17.485816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:17.495751 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:17.497390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc22e-0d2a-4ba7-a05c-900a3339f4a6 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:17.508107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1084/2184] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:18.035012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759976-4408-40fd-91df-ab7058b1759c None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.035303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759976-4408-40fd-91df-ab7058b1759c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.035579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759976-4408-40fd-91df-ab7058b1759c None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.038206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1101/2185] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 13:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:02:18.046179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbf1a-c66d-4d00-911d-a60d0102f42e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.046469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbf1a-c66d-4d00-911d-a60d0102f42e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.046745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbf1a-c66d-4d00-911d-a60d0102f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.085459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-540cbf1a-c66d-4d00-911d-a60d0102f42e None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:18.086717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-540cbf1a-c66d-4d00-911d-a60d0102f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.096387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1085/2186] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:18.108754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759976-4408-40fd-91df-ab7058b1759c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.110476 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-64759976-4408-40fd-91df-ab7058b1759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.190401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759976-4408-40fd-91df-ab7058b1759c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.193966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.194624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.194913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.195195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.205688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.207118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d63687-a677-4959-a30f-3e448f0f3238 service glance] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.218900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1102/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:18.439561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494cbc4-1858-49d5-8d30-63e47e6d9020 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.439852 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494cbc4-1858-49d5-8d30-63e47e6d9020 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.440127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494cbc4-1858-49d5-8d30-63e47e6d9020 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.443973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1086/2188] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:02:18.446761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42ad0-bd8c-4317-a1c5-62264db32e78 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.447206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42ad0-bd8c-4317-a1c5-62264db32e78 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.447338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42ad0-bd8c-4317-a1c5-62264db32e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.466914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2ed42ad0-bd8c-4317-a1c5-62264db32e78 None None] MFA Rules not processed for user `20f2aac78555431ca685e3b43d27b099`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:18.468122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2ed42ad0-bd8c-4317-a1c5-62264db32e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.475272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1103/2189] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:18.486745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494cbc4-1858-49d5-8d30-63e47e6d9020 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.498554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494cbc4-1858-49d5-8d30-63e47e6d9020 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.502225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.502878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.503166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.503477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.511750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.513246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d40ae4-8695-46e6-a755-d9dce0398a4d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.521576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1087/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:18.603592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0441-2c64-4ddf-a45f-477d187f98c4 None None] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.603885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0441-2c64-4ddf-a45f-477d187f98c4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.604165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0441-2c64-4ddf-a45f-477d187f98c4 None None] PATH_INFO: `/` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.605605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1104/2191] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 5 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:02:18.610466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc9fa-e7b5-40f4-b15f-9a743edb5967 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.610755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc9fa-e7b5-40f4-b15f-9a743edb5967 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.611034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc9fa-e7b5-40f4-b15f-9a743edb5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.630041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-109cc9fa-e7b5-40f4-b15f-9a743edb5967 None None] MFA Rules not processed for user `90b3884fbabf435dab3e9a017e9d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:18.631743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-109cc9fa-e7b5-40f4-b15f-9a743edb5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.641544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1088/2192] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:18.652351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0441-2c64-4ddf-a45f-477d187f98c4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.663215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0441-2c64-4ddf-a45f-477d187f98c4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.666827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.667465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.667783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.668072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.678294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.679736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.690507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1105/2193] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:23.162143 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ac1f-57d4-4291-996b-7dc80a2960d2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:23.162766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ac1f-57d4-4291-996b-7dc80a2960d2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:23.162766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1ac1f-57d4-4291-996b-7dc80a2960d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:23.180450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ffa1ac1f-57d4-4291-996b-7dc80a2960d2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:23.181866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ffa1ac1f-57d4-4291-996b-7dc80a2960d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:23.189580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1089/2194] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:23.228505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:23.239677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca00f7-2b67-4be5-8ec9-e05357f8d5f7 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:23.245516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:23.246157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:23.246446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:23.246774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:23.254852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:23.257246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:23.266734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1106/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:25.959048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1439-456d-48f6-bf12-615228b7a0d1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:25.959523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1439-456d-48f6-bf12-615228b7a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:25.959645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec1439-456d-48f6-bf12-615228b7a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:25.977598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-54ec1439-456d-48f6-bf12-615228b7a0d1 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:25.978982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-54ec1439-456d-48f6-bf12-615228b7a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:25.986592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1090/2196] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:26.000276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:26.012295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed8de-9f5e-4e68-b193-aa1c814f0f6d service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:26.017611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:26.018271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:26.018559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:26.019017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:26.028612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:26.030354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:26.038947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1107/2197] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:02:35.972114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=69 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:36.035361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:51.042169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106ff0-d994-446c-91f5-2527c7e27d10 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:51.042683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106ff0-d994-446c-91f5-2527c7e27d10 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:51.042801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106ff0-d994-446c-91f5-2527c7e27d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:51.060985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4b106ff0-d994-446c-91f5-2527c7e27d10 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:51.062206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4b106ff0-d994-446c-91f5-2527c7e27d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:51.070820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1091/2198] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:51.093519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:51.105294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01ec3e-0fa9-4ea4-8a1b-f565b627d396 service swift] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:51.110812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:51.111454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:51.111742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:51.112021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:51.120813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:51.122275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:51.132587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1108/2199] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:56.107732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5277-293d-4150-b578-0cbbae3c3837 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:56.108163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5277-293d-4150-b578-0cbbae3c3837 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:56.108291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5277-293d-4150-b578-0cbbae3c3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:56.126474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-69eb5277-293d-4150-b578-0cbbae3c3837 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:56.127681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-69eb5277-293d-4150-b578-0cbbae3c3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:56.135741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1092/2200] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:56.158072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:56.169449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd656-0d82-40d9-9f5d-69451584e927 service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:56.174855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:56.175613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:56.175973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:56.176324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:56.185019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:56.187630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:56.195290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1109/2201] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:02:56.325553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e5bb-65dc-4267-bb86-4dd7ba0bb658 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:56.325844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e5bb-65dc-4267-bb86-4dd7ba0bb658 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:56.326124 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e5bb-65dc-4267-bb86-4dd7ba0bb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:56.344206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-01d6e5bb-65dc-4267-bb86-4dd7ba0bb658 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:56.345383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-01d6e5bb-65dc-4267-bb86-4dd7ba0bb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:56.353974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1093/2202] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:56.380112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:56.392065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2cc-b2fb-4079-bd8a-e4a43fd842aa service swift] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:56.397937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:56.399121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:56.399121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:56.399321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:56.407488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:56.409091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:56.419406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1110/2203] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:06.339019 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=9 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:06.415065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=18 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:17.839335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:17.839827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:17.839940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:17.857909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] MFA Rules not processed for user `8f6142b570b043c4996624a980c2da8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:17.859123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:17.913610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1094/2204] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:03:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:27.906463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=25 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:38.243964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:38.253111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12241-f9ae-4926-829b-ce8c2cc38587 service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:38.257044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:38.257695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:38.257988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:38.258277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:38.260086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:38.284395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:38.284395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dab23b-ef64-4d3b-a6c7-b289dcf56a4d service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:38.289874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1111/2205] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:39.568323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:39.579084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a32ed-2e05-466e-b88c-0a5432e42929 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:39.582960 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:39.583399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:39.583690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:39.584282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:39.586258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:39.604038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:39.605673 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:39.619397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1095/2206] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:39.828127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc79e1-3b68-448f-91b1-16fca9178ab0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:39.828767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc79e1-3b68-448f-91b1-16fca9178ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:39.828767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc79e1-3b68-448f-91b1-16fca9178ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:39.846298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c3bc79e1-3b68-448f-91b1-16fca9178ab0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:39.848318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c3bc79e1-3b68-448f-91b1-16fca9178ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:39.856091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1112/2207] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:39.880771 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:39.891857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1d32-9a02-4b4e-b4ae-35b246aca89b service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:39.898003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:39.898640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:39.898923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:39.899199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:39.907289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:39.908893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:39.919069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1096/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:44.446948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:44.446948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:44.446948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:44.470589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:44.472045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:44.482098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1113/2209] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:44.673498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:44.686112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:44.686849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b289-5645-4579-8da3-e3281d56b8d0 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:44.693223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:44.698452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:44.698452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:44.698452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:44.698452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:44.699422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d2c64-28ba-4f4a-a008-95896d619971 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:44.705004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:44.705664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:44.705951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:44.706412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:44.708278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:44.710687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a561-2eb3-4501-9057-b5800e7d84da service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:44.715988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:44.717719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:44.720094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1097/2210] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:44.728250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1114/2211] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:03:51.403376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f8b-d1f6-403b-b18a-4d814357545d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:51.403872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f8b-d1f6-403b-b18a-4d814357545d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:51.404150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f8b-d1f6-403b-b18a-4d814357545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:51.422095 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6a030f8b-d1f6-403b-b18a-4d814357545d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:51.423327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6a030f8b-d1f6-403b-b18a-4d814357545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:51.432189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1098/2212] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:51.456043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:51.467086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca104-d2c8-44ba-baa1-27bf3f6ce250 service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:51.472492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:51.473177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:51.473468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:51.473748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:51.481930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:51.483533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:51.493957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1115/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:56.668617 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57714c2-24c9-43d5-8043-a2d00eefe035 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:56.669147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57714c2-24c9-43d5-8043-a2d00eefe035 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:56.669147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57714c2-24c9-43d5-8043-a2d00eefe035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:56.688462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c57714c2-24c9-43d5-8043-a2d00eefe035 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:56.689704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c57714c2-24c9-43d5-8043-a2d00eefe035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:56.698394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1099/2214] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:56.727774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:56.741405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c05d-3d93-460d-a4f2-54049e2d5a0f service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:56.747543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:56.748024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:56.748313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:56.748595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:56.758220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:56.759812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:56.769983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1116/2215] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:04.034604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:04.035087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:04.035501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:04.057357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:04.058669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:04.067076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1100/2216] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Jul 5 13:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:04.094408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:04.107099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1c9-53fe-4adc-9e53-e2e335fd25b9 service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:04.112733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:04.113399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:04.113716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:04.113994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:04.122981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:04.124582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdbcf1-5bab-4f1a-979c-1d5fb01650c1 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:04.135094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1117/2217] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:06.007463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:06.028755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd15b9-0f82-4ac7-a5a9-f0e80ef06984 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:06.035368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:06.036427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:06.036957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:06.037446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:06.039308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:06.100444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:06.102099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:06.111509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1101/2218] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:07.288736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:07.289224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:07.289365 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:07.295038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=37 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:07.306394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] MFA Rules not processed for user `b75999cf46b744d2b5623c5615db2401`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:07.307594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:07.314436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1118/2219] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:04:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:07.617688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:07.627749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d79a-ce43-459d-9ff0-b19b0a0c1d6b service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:07.632615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:07.633343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:07.633629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:07.633905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:07.635726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:07.645943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:07.658691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:07.658691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1102/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:08.128087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.129593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:08.144048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8165-f6ab-4b90-8e96-ee04ba4bb288 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.149552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.150250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.150573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.150885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.152702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:08.165688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.167287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.178134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1119/2221] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:14.100991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:14.109969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=62 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:14.117972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623dd16-83ea-4edb-ad14-9e9cb929e2eb service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:14.126044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:14.126778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:14.135047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:14.135047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:14.135047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:14.146349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:14.147917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:14.160194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1103/2222] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:18.173293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=8 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:18.541863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:18.551611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc400b3-30b2-42db-8a97-5fe86541e762 service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:18.555758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:18.555758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:18.556034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:18.556269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:18.558251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:18.569356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:18.570875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccab96e-b38e-4cc1-acf2-f377bb5f2d7b service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:18.580540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1120/2223] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:19.624883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:19.642093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d53ba-829c-4b85-89fd-7ad775d7892e service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:19.651389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:19.652074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:19.652365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:19.652640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:19.655055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:19.681322 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:19.686449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024908f7-2623-4a4d-8e94-1acfd540bbe7 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:19.696171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1104/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:24.320006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.320562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.320562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.338185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] MFA Rules not processed for user `530fb849889d42f690140305499ef7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:24.340271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:24.346381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1121/2225] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:25.699879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:25.700429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:25.700599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:25.719804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] MFA Rules not processed for user `a426eed4598345878445c6ba2ab913d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:25.721062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:25.729376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1105/2226] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:04:29.559086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:29.573453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b33cc-a77b-4754-96f8-caa93c7de3f3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:29.579061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:29.579751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:29.580040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:29.580320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:29.582685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:29.596489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:29.599477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:29.613185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1122/2227] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:35.713486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=14 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:39.607083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=15 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:49.971508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:49.972981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:49.989230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a831d2-f3e7-446c-b51b-f7a39bab2791 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:49.994845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:49.995536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:49.995819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:49.996777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:49.998864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:50.013569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:50.015226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:50.027101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1106/2228] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:50.113955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:50.115669 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:50.130152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40895-74ed-483c-9d17-f6f783c4bc52 service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:50.134584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:50.135458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:50.135751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:50.136029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] PATH_INFO: `/v3/users/8f6142b570b043c4996624a980c2da8d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:50.137270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6142b570b043c4996624a980c2da8d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:50.139203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:50.306195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6142b570b043c4996624a980c2da8d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.313693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6142b570b043c4996624a980c2da8d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.314384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6142b570b043c4996624a980c2da8d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.315581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6142b570b043c4996624a980c2da8d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.382601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6142b570b043c4996624a980c2da8d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.400836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1123/2229] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:50 2022] DELETE /identity/v3/users/8f6142b570b043c4996624a980c2da8d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:50.632010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:50.641624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3d12e-edc1-42de-9f95-2808f52aecdf service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:50.700251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:50.701166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:50.701450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:50.701725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] PATH_INFO: `/v3/projects/1e6949ef295b410fbceb1e1ffd064512` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:50.702914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6949ef295b410fbceb1e1ffd064512)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:50.704869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:50.839959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6949ef295b410fbceb1e1ffd064512', 'request_id': 'req-d70975c3-b02f-4327-ae45-2bc98808f509'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.943104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6949ef295b410fbceb1e1ffd064512', 'request_id': 'req-d70975c3-b02f-4327-ae45-2bc98808f509'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.949899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6949ef295b410fbceb1e1ffd064512', 'request_id': 'req-d70975c3-b02f-4327-ae45-2bc98808f509'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.961270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] The token cache is being invalidate because project 1e6949ef295b410fbceb1e1ffd064512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:50.961563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.962192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d70975c3-b02f-4327-ae45-2bc98808f509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:50.963743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1107/2230] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:50 2022] DELETE /identity/v3/projects/1e6949ef295b410fbceb1e1ffd064512 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:58.272301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:58.273833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:58.331279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e0d16-1a04-4115-957f-242468ee1002 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:58.380407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:58.381098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:58.381386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:58.381692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:58.383506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:58.425630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:58.441380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:58.442857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5371e9-00f6-47c3-a2a6-854cd8342952 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:58.451862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1124/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:00.958251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:07.433174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:07.433807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:07.433807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:07.452406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] MFA Rules not processed for user `faa03e9023bb4b7a84cee7fa85bcf1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:07.453647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:07.461313 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1108/2232] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:05:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:08.799641 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=8 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:12.943181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:12.943742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:12.943742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:12.961350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:12.962539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:13.018580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1125/2233] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:13.381747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:13.382481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:13.453141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3087a5-44a2-40ad-a05d-80968781f28a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:13.459142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:13.459799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:13.460086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:13.460364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:13.468633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:13.470606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:13.478615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1109/2234] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:18.379829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:18.381317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:18.451297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593dc0-d01e-4d96-a28f-da8076ffe4d0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:18.457319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:18.458037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:18.458323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:18.458690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:18.460513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:18.473228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:18.474822 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:18.487805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1126/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:22.189109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:22.191218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:22.260101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0688-e9f0-4dbc-b445-48ecb1940e6e service swift] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:22.264626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:22.265534 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:22.265810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:22.266165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] PATH_INFO: `/v3/users/c1ede724f1e44fc5a0544338c3a49584` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:22.267943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ede724f1e44fc5a0544338c3a49584)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:22.270570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:22.424018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ede724f1e44fc5a0544338c3a49584'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:22.424868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ede724f1e44fc5a0544338c3a49584'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:22.425474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ede724f1e44fc5a0544338c3a49584'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:22.432316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ede724f1e44fc5a0544338c3a49584'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:22.513640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ede724f1e44fc5a0544338c3a49584'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:22.533058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1110/2236] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:22 2022] DELETE /identity/v3/users/c1ede724f1e44fc5a0544338c3a49584 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:22.794889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:22.806288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ecf8a-8951-46b9-b042-66065a441029 service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:22.866297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:22.867488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:22.867773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:22.868053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] PATH_INFO: `/v3/projects/ea071663174f44d488b6fd706ece6653` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:22.869547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea071663174f44d488b6fd706ece6653)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:22.871478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:22.985916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:22.995153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea071663174f44d488b6fd706ece6653', 'request_id': 'req-a8f1dab0-7507-4c13-ae8f-e300eb42281e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.079371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea071663174f44d488b6fd706ece6653', 'request_id': 'req-a8f1dab0-7507-4c13-ae8f-e300eb42281e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.086371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea071663174f44d488b6fd706ece6653', 'request_id': 'req-a8f1dab0-7507-4c13-ae8f-e300eb42281e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.097857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] The token cache is being invalidate because project ea071663174f44d488b6fd706ece6653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:23.098146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.098798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.100604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1127/2237] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:22 2022] DELETE /identity/v3/projects/ea071663174f44d488b6fd706ece6653 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:23.104457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:23.107656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:23.115017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:23.122041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940dab3-15fd-40f6-86f6-502175f129b1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:23.183909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:23.184841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:23.185172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:23.185555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] PATH_INFO: `/v3/users/0a2525d45cd34901aedd2ab89c4a57aa` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:23.186860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2525d45cd34901aedd2ab89c4a57aa)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:23.188831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:23.367918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2525d45cd34901aedd2ab89c4a57aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.368596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2525d45cd34901aedd2ab89c4a57aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.369409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2525d45cd34901aedd2ab89c4a57aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.376664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2525d45cd34901aedd2ab89c4a57aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.462541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2525d45cd34901aedd2ab89c4a57aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:23.486280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1111/2238] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:23 2022] DELETE /identity/v3/users/0a2525d45cd34901aedd2ab89c4a57aa => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:23.852162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:23.853670 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:23.866861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1dab0-7507-4c13-ae8f-e300eb42281e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:23.924798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:23.925671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:23.925955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:23.926231 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] PATH_INFO: `/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:23.927427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e82dffe53b4a06ac3a8a7b81aaabe5)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:23.929441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:24.069866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e82dffe53b4a06ac3a8a7b81aaabe5', 'request_id': 'req-696dde7c-498e-47c6-8927-f5c01971dc1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:24.153623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e82dffe53b4a06ac3a8a7b81aaabe5', 'request_id': 'req-696dde7c-498e-47c6-8927-f5c01971dc1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:24.161332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e82dffe53b4a06ac3a8a7b81aaabe5', 'request_id': 'req-696dde7c-498e-47c6-8927-f5c01971dc1b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:24.172329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] The token cache is being invalidate because project b1e82dffe53b4a06ac3a8a7b81aaabe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:24.172622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:24.173306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:24.174891 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1128/2239] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:23 2022] DELETE /identity/v3/projects/b1e82dffe53b4a06ac3a8a7b81aaabe5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:33.481538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:34.168996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:37.468035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:37.469453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:37.533004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a575-3baa-4347-aef0-6094a28a4c35 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:37.581148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:37.581747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:37.582032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:37.582308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:37.584093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:37.642778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:37.644384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:37.653291 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1112/2240] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:47.649185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=68 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:01.594759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:01.596176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:01.653373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dde7c-498e-47c6-8927-f5c01971dc1b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:01.657480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:01.658173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:01.658463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:01.658745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:01.660577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:01.726679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:01.728134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:01.738223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1129/2241] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:05.501234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:05.502747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:05.523628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bb11b-56ac-45e8-bfbc-f244e2350567 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:05.532627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:05.533781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:05.534376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:05.534660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] PATH_INFO: `/v3/users/530fb849889d42f690140305499ef7e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:05.535957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530fb849889d42f690140305499ef7e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:05.538559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:05.710685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530fb849889d42f690140305499ef7e3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:05.711655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530fb849889d42f690140305499ef7e3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:05.712738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530fb849889d42f690140305499ef7e3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:05.719718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530fb849889d42f690140305499ef7e3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:05.832572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d9f338c1-2975-4e90-8f7a-b331441ed319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530fb849889d42f690140305499ef7e3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:05.853598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1113/2242] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:05 2022] DELETE /identity/v3/users/530fb849889d42f690140305499ef7e3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:06.154588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:06.167207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f459-9f50-43f1-af0e-a052b81017fe service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:06.237263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:06.238252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.238611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.238959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] PATH_INFO: `/v3/projects/31f72098d6ff4c3db21952a3df3c6eaf` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.240280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f72098d6ff4c3db21952a3df3c6eaf)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:06.243571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:06.384232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f72098d6ff4c3db21952a3df3c6eaf', 'request_id': 'req-39fb0891-3b2a-4c7f-9159-acf45fd5351c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:06.387810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:06.477808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f72098d6ff4c3db21952a3df3c6eaf', 'request_id': 'req-39fb0891-3b2a-4c7f-9159-acf45fd5351c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:06.484908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f72098d6ff4c3db21952a3df3c6eaf', 'request_id': 'req-39fb0891-3b2a-4c7f-9159-acf45fd5351c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:06.496270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] The token cache is being invalidate because project 31f72098d6ff4c3db21952a3df3c6eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:06.496562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:06.497230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-39fb0891-3b2a-4c7f-9159-acf45fd5351c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:06.498767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1130/2243] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:06 2022] DELETE /identity/v3/projects/31f72098d6ff4c3db21952a3df3c6eaf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:06.503632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.504145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.504240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.533607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:06.533607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:06.595040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1114/2244] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:06.604011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.604308 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.606284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.627871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:06.629137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:06.637449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1131/2245] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:06.641693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:06.653081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451e93-cc69-4437-9129-a49c2109917a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:06.660092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:06.660898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.661184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.661464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.662197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:06.662508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:06.665238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:06.677447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1115/2246] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:06.682833 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:06.691932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94805e-9190-475e-a617-34aa02f697ea None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:06.696649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:06.697330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.697611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.697883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.698570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:06.700472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:06.799195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1132/2247] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:06 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:06.803337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:06.813686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada059-3796-4c4f-b225-df4b56cd53a6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:06.875844 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:06.876524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:06.876872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:06.877153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:06.877877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:06.879826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:06.886602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:06.983037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1116/2248] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:06 2022] POST /identity/v3/users => generated 279 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:06.988647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:06.997753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d719-10d7-461a-9a84-a30cc969c712 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.003968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.003968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.003968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.003968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.007207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.007207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.020452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1133/2249] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:07.021620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.032457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df342f-4723-457a-ab87-c8f8681c28b0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.037171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.038642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.038933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.039208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.039944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.041571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e1f4a-716c-42cd-83d7-b0c4350c1b08 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.052218 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1117/2250] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:07.056497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.066447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feaca4-d684-4d65-ae54-457e2b6cd86a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.072017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.072940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.073223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.073495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] PATH_INFO: `/v3/projects/1c1a34a27bd94c0db25f8ba3bc2b0917/users/804a35fb9d694f759931c954fe162b4d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.091691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1a34a27bd94c0db25f8ba3bc2b0917, user_id=804a35fb9d694f759931c954fe162b4d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.091880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.182709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1134/2251] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:07 2022] PUT /identity/v3/projects/1c1a34a27bd94c0db25f8ba3bc2b0917/users/804a35fb9d694f759931c954fe162b4d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:06:07.203748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.204394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.204689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.232530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] MFA Rules not processed for user `804a35fb9d694f759931c954fe162b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:07.233793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:07.304490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1118/2252] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:07.310112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.381219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2edd-2706-4fb1-911c-62540934ae9e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.431818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.431818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.431818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.431818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.432601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.432601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.545708 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1135/2253] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:07 2022] POST /identity/v3/projects => generated 355 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:07.547018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.559614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61fa28-7770-409b-923a-0dd8ee4392b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.622966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.623591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.623837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.624111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.624933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.626943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.733941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1119/2254] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:07 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:07.737824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.749337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ff82-0cdf-4985-9e71-8f0cc2bf3315 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.754048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.754723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.755002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.755737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.756014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.758039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.773846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1136/2255] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:07.775370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.785508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9776-bc1b-4150-ab85-5fa2376d0374 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.790839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.791734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.792023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.792300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] PATH_INFO: `/v3/projects/4fb2784413794a19a89ba06cb76e50fe/users/0ab2f06c67df44f08d61c8e248e7bb22/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.807181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb2784413794a19a89ba06cb76e50fe, user_id=0ab2f06c67df44f08d61c8e248e7bb22, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.809908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:07.907696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1120/2256] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:07 2022] PUT /identity/v3/projects/4fb2784413794a19a89ba06cb76e50fe/users/0ab2f06c67df44f08d61c8e248e7bb22/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:07.911675 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:07.922942 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ce54-d2c3-4598-8732-44e2368d9360 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:07.968815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:07.985604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:07.986336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:07.986831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:07.987126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:07.987911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:07.990215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e8ab-5a80-4ce7-a047-6d99b46b4d66 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:08.001454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1137/2257] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:08.007969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:08.025393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508aa2-7872-4ebe-a3fa-6fd71b55de68 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:08.030461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:08.031366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:08.031750 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:08.031953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] PATH_INFO: `/v3/projects/4fb2784413794a19a89ba06cb76e50fe/users/0ab2f06c67df44f08d61c8e248e7bb22/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:08.034106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb2784413794a19a89ba06cb76e50fe, user_id=0ab2f06c67df44f08d61c8e248e7bb22, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:08.037059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:08.051562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1121/2258] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:08 2022] PUT /identity/v3/projects/4fb2784413794a19a89ba06cb76e50fe/users/0ab2f06c67df44f08d61c8e248e7bb22/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:08.063161 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:08.063503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:08.063786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:08.091820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] MFA Rules not processed for user `0ab2f06c67df44f08d61c8e248e7bb22`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:08.093074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:08.163209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1138/2259] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:08.176068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:08.176068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:08.199386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:08.234528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91d7fd-26f2-4034-b77b-1a5cc56e653b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:08.238244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:08.244965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:08.244965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:08.244965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:08.249671 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:08.251123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7182c-c613-4f56-a976-f8c6b4c614c7 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:08.262290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1122/2260] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:08.480245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:08.489840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2b1f-6891-46e4-ab20-b17e372ab922 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:08.494716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:08.495368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:08.495659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:08.495938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:08.555008 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:08.556597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:08.565969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1139/2261] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:10.336733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5656-448f-4602-827b-977c02a03f32 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:10.337256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5656-448f-4602-827b-977c02a03f32 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:10.337362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5656-448f-4602-827b-977c02a03f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:10.355114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e85c5656-448f-4602-827b-977c02a03f32 None None] MFA Rules not processed for user `b75999cf46b744d2b5623c5615db2401`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:10.356375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e85c5656-448f-4602-827b-977c02a03f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:10.413837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1123/2262] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:10.732275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:10.733719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:10.790301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7b6f0-3d73-49cc-a45e-71ad47d2d724 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:10.793915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:10.794601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:10.794887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:10.795169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:10.796961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:10.806610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:10.808041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:10.815904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1140/2263] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:20.406293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=42 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:20.812417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:26.372146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:26.372633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:26.372820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:26.390780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:26.391996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:26.451195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1124/2264] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:26.580045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:26.581622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:26.661954 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199984b1-018f-4c13-b884-911880fb3d7c service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:26.667622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:26.668562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:26.669058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:26.669496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:26.679671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:26.681688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913501a-f54b-41d5-9815-09c01998bc40 service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:26.691916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1141/2265] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:28.647108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:28.736084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338f62f-4a03-40a7-a0e3-7956aee077ff None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:28.741375 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:28.742330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:28.742700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:28.742981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] PATH_INFO: `/v3/users/804a35fb9d694f759931c954fe162b4d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:28.744476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804a35fb9d694f759931c954fe162b4d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:28.746450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:28.942588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804a35fb9d694f759931c954fe162b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:28.944091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804a35fb9d694f759931c954fe162b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:28.945057 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804a35fb9d694f759931c954fe162b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:28.953705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804a35fb9d694f759931c954fe162b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:29.030437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804a35fb9d694f759931c954fe162b4d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:29.057426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1125/2266] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:28 2022] DELETE /identity/v3/users/804a35fb9d694f759931c954fe162b4d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:29.061713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:29.062185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:29.062692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:29.086472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:29.087941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:29.169568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1142/2267] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:29.180175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:29.181764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:29.212022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:29.254627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607fd72-0eb4-43d9-80a1-2b168743b775 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:29.261038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:29.261789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:29.262259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:29.262569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:29.276546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:29.278027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:29.289424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1126/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:30.102451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:30.107909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:30.121073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2e37-d787-487a-836f-5469a666aced None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:30.127604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:30.128488 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:30.128811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:30.129093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] PATH_INFO: `/v3/projects/1c1a34a27bd94c0db25f8ba3bc2b0917` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:30.130376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1a34a27bd94c0db25f8ba3bc2b0917)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:30.132895 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:30.243932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1a34a27bd94c0db25f8ba3bc2b0917', 'request_id': 'req-f62ee37b-6631-44b2-80d0-d082bd084a0a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.335395 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1a34a27bd94c0db25f8ba3bc2b0917', 'request_id': 'req-f62ee37b-6631-44b2-80d0-d082bd084a0a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.342627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1a34a27bd94c0db25f8ba3bc2b0917', 'request_id': 'req-f62ee37b-6631-44b2-80d0-d082bd084a0a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.359899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] The token cache is being invalidate because project 1c1a34a27bd94c0db25f8ba3bc2b0917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:30.360429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.361475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.363538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1143/2269] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:30 2022] DELETE /identity/v3/projects/1c1a34a27bd94c0db25f8ba3bc2b0917 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:30.371268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:30.385212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dbfcb-4001-4cd0-bf8f-bab04aad5080 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:30.457075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:30.458655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:30.459446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:30.459446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] PATH_INFO: `/v3/users/0ab2f06c67df44f08d61c8e248e7bb22` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:30.460722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab2f06c67df44f08d61c8e248e7bb22)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:30.462938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:30.676523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab2f06c67df44f08d61c8e248e7bb22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.678274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab2f06c67df44f08d61c8e248e7bb22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.679164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab2f06c67df44f08d61c8e248e7bb22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.688456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab2f06c67df44f08d61c8e248e7bb22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.781421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-89861030-7914-47f6-a041-fb776764ecce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab2f06c67df44f08d61c8e248e7bb22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:30.813650 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1127/2270] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:30 2022] DELETE /identity/v3/users/0ab2f06c67df44f08d61c8e248e7bb22 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:31.283836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:31.285490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:31.310467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee37b-6631-44b2-80d0-d082bd084a0a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:31.323452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:31.386247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:31.387702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:31.388375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:31.389673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] PATH_INFO: `/v3/projects/4fb2784413794a19a89ba06cb76e50fe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:31.393680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb2784413794a19a89ba06cb76e50fe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:31.397452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:31.552462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb2784413794a19a89ba06cb76e50fe', 'request_id': 'req-b7f5cf2f-d597-475a-af5b-6ae76e542e73'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:31.735696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb2784413794a19a89ba06cb76e50fe', 'request_id': 'req-b7f5cf2f-d597-475a-af5b-6ae76e542e73'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:31.743729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb2784413794a19a89ba06cb76e50fe', 'request_id': 'req-b7f5cf2f-d597-475a-af5b-6ae76e542e73'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:31.754927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] The token cache is being invalidate because project 4fb2784413794a19a89ba06cb76e50fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:31.755247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:31.756037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b7f5cf2f-d597-475a-af5b-6ae76e542e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:31.757949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1144/2271] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:31 2022] DELETE /identity/v3/projects/4fb2784413794a19a89ba06cb76e50fe => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:31.762646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:31.763497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:31.763497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:31.782604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:31.783888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:31.839603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:31.870745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1128/2272] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:31.871917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:31.872228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:31.872493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:31.897985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:31.899609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:31.912819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1145/2273] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:31.917217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:31.930370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a80ed-80de-4539-8ec8-6ba91ca6d6eb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:31.936974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:31.937992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:31.938497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:31.939017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:31.939872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:31.940290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:31.942038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:31.957153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1129/2274] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:31.961899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:31.972786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ab0-1a9b-472b-8392-3c6f2dc3022b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:31.979102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:31.979839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:31.980238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:31.980611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:31.981449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:31.983477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:32.080709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1146/2275] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:31 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:32.085062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:32.097728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a785f6-b547-4b22-9837-1c295647c558 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:32.165814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:32.166507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.166790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.167069 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.167963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:32.170050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:32.269782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1130/2276] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:32 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:06:32.274613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:32.287536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03c94-26d7-405d-b7fc-0a5e58ddaa1a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:32.292332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:32.293049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.293340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.293753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.294627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:32.296228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:32.309004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1147/2277] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:32.312651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:32.327400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7ed1-7e72-43e2-85db-f9f6a0e2f45c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:32.332476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:32.333207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.333658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.333828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.334578 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:32.336306 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015a483-25b0-4ea8-ba76-ded085e4de96 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:32.348201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1131/2278] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:32.352959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:32.365603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768e63-5f5f-4512-a992-7892fc300b26 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:32.370949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:32.371858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.372146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.372429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] PATH_INFO: `/v3/projects/721f17654c094dc7a0240615cd12d7e3/users/76fad7e82abf4d08aeea8a12f1b8f9ad/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.393410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=721f17654c094dc7a0240615cd12d7e3, user_id=76fad7e82abf4d08aeea8a12f1b8f9ad, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:32.396919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:32.477989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1148/2279] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:32 2022] PUT /identity/v3/projects/721f17654c094dc7a0240615cd12d7e3/users/76fad7e82abf4d08aeea8a12f1b8f9ad/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:32.488316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.488614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.488928 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.521648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] MFA Rules not processed for user `76fad7e82abf4d08aeea8a12f1b8f9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:32.522900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:32.595058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1132/2280] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:32.600213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:32.647067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:32.671169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8693f-427d-48a0-9fff-268191fafe6b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:32.676358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:32.677919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:32.678351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:32.678702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:32.679602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:32.681711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.162985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1149/2281] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:32 2022] POST /identity/v3/projects => generated 379 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:33.164174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.176145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091686c-c0e6-45b5-8f2d-88a6ef4e362e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.216993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:33.234476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.235589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.235589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.235818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.236458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:33.238477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.433380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1133/2282] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:33 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:33.437483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.448878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9716-90d0-49e7-a6ab-13b7af9406d1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.454355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.458171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.459672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.460018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.460915 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:33.462567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.476195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1150/2283] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:33.481299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.492507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd6b90-374c-4ee7-9220-12ffa60bb641 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.497948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.499030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.499282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.499559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] PATH_INFO: `/v3/projects/1389a33065d04146bc37c13dd4654811/users/74c366d8f4dd4e2987847b1952cbfb11/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.517950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389a33065d04146bc37c13dd4654811, user_id=74c366d8f4dd4e2987847b1952cbfb11, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:33.520806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.593308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1134/2284] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:33 2022] PUT /identity/v3/projects/1389a33065d04146bc37c13dd4654811/users/74c366d8f4dd4e2987847b1952cbfb11/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:33.597075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.609820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a0188-ec78-42a9-9f89-11f6b1b5656b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.680076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.680932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.681286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.681702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.682452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:33.684212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfaaff-e1c0-40cc-861a-809b8fb797e0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.696307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1151/2285] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:33.700647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.713803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce241-baed-4937-bdb3-1ea1ab00f7d9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.718805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.719782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.720202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.720548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] PATH_INFO: `/v3/projects/1389a33065d04146bc37c13dd4654811/users/74c366d8f4dd4e2987847b1952cbfb11/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.722756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389a33065d04146bc37c13dd4654811, user_id=74c366d8f4dd4e2987847b1952cbfb11, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:33.725889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:33.741627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1135/2286] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:33 2022] PUT /identity/v3/projects/1389a33065d04146bc37c13dd4654811/users/74c366d8f4dd4e2987847b1952cbfb11/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:33.754031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.754897 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.755394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:33.801798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] MFA Rules not processed for user `74c366d8f4dd4e2987847b1952cbfb11`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:33.804483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:33.884728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1152/2287] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:33.900210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:33.902292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:33.991330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8375e-249a-4b69-bf93-587b0b40625d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:33.995363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:33.996018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:33.996305 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:33.996582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:34.072608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:34.074287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:34.085147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1136/2288] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:35.824219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:35.825736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:35.839222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8573b75-7998-406d-9f47-85a5115c7ac0 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:35.843226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:35.843987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:35.844346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:35.844633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:35.858222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:35.859764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f178-4ab6-4e0d-b313-97c592c33993 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:35.874741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1153/2289] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:41.436721 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:41.501882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:41.516008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbc68-4f22-4856-8af0-a327462279df service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:41.520573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:41.522038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:41.522430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:41.522712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] PATH_INFO: `/v3/users/76fad7e82abf4d08aeea8a12f1b8f9ad` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:41.523933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fad7e82abf4d08aeea8a12f1b8f9ad)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:41.525896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:41.725803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fad7e82abf4d08aeea8a12f1b8f9ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:41.726467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fad7e82abf4d08aeea8a12f1b8f9ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:41.727064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fad7e82abf4d08aeea8a12f1b8f9ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:41.733975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fad7e82abf4d08aeea8a12f1b8f9ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:41.801100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fad7e82abf4d08aeea8a12f1b8f9ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:41.823212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1137/2290] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:41 2022] DELETE /identity/v3/users/76fad7e82abf4d08aeea8a12f1b8f9ad => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:41.827812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:41.828305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:41.828409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:41.848235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:41.849539 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:41.867794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:41.915736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1154/2291] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:41.925641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:41.927167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:41.987459 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8325c90-dcfe-41ec-aebe-3c1ecc375671 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:41.992267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:41.992973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:41.993265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:41.993543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:42.003091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:42.004532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:42.015652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1138/2292] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:42.043836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:42.045554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:42.144616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b7ff-aca3-4e87-8bed-bd575ec5cbc9 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:42.149940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131782e4-7929-4381-920c-766388a769a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:42.150715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131782e4-7929-4381-920c-766388a769a4 service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:42.151026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131782e4-7929-4381-920c-766388a769a4 service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:42.151313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131782e4-7929-4381-920c-766388a769a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:42.153196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-131782e4-7929-4381-920c-766388a769a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:42.165224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131782e4-7929-4381-920c-766388a769a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:42.166816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131782e4-7929-4381-920c-766388a769a4 service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:42.177143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1155/2293] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:42.463362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:42.464883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:42.479103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4cca4-1345-4402-a636-4ee84100a1ab service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:42.483969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:42.485185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:42.485185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:42.485480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] PATH_INFO: `/v3/projects/721f17654c094dc7a0240615cd12d7e3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:42.486697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721f17654c094dc7a0240615cd12d7e3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:42.488640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:42.584964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721f17654c094dc7a0240615cd12d7e3', 'request_id': 'req-80dca671-6612-4a6c-b97b-f540464cc056'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:42.730133 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721f17654c094dc7a0240615cd12d7e3', 'request_id': 'req-80dca671-6612-4a6c-b97b-f540464cc056'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:42.741883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721f17654c094dc7a0240615cd12d7e3', 'request_id': 'req-80dca671-6612-4a6c-b97b-f540464cc056'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:42.746589 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:42.753678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] The token cache is being invalidate because project 721f17654c094dc7a0240615cd12d7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:42.753964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:42.754612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:42.756159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1139/2294] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:42 2022] DELETE /identity/v3/projects/721f17654c094dc7a0240615cd12d7e3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:42.760335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131782e4-7929-4381-920c-766388a769a4 service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:42.771674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131782e4-7929-4381-920c-766388a769a4 service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:42.832403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:42.833248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:42.834053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:42.834326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] PATH_INFO: `/v3/users/74c366d8f4dd4e2987847b1952cbfb11` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:42.835731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c366d8f4dd4e2987847b1952cbfb11)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:42.837875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:43.109293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c366d8f4dd4e2987847b1952cbfb11'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.114552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:43.116774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c366d8f4dd4e2987847b1952cbfb11'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.117453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c366d8f4dd4e2987847b1952cbfb11'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.118041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c366d8f4dd4e2987847b1952cbfb11'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.204310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-29b50d07-bdca-4f2e-8ae1-084cc00f6203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c366d8f4dd4e2987847b1952cbfb11'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.223865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1156/2295] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:42 2022] DELETE /identity/v3/users/74c366d8f4dd4e2987847b1952cbfb11 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:43.600347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:43.602114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:43.620402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca671-6612-4a6c-b97b-f540464cc056 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:43.678502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:43.692039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:43.692039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:43.692039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] PATH_INFO: `/v3/projects/1389a33065d04146bc37c13dd4654811` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:43.692039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1389a33065d04146bc37c13dd4654811)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:43.692039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:43.799024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1389a33065d04146bc37c13dd4654811', 'request_id': 'req-383674a0-c6a6-438b-b51e-a7dc0197f6e7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.881854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1389a33065d04146bc37c13dd4654811', 'request_id': 'req-383674a0-c6a6-438b-b51e-a7dc0197f6e7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.884761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1389a33065d04146bc37c13dd4654811', 'request_id': 'req-383674a0-c6a6-438b-b51e-a7dc0197f6e7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.895386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] The token cache is being invalidate because project 1389a33065d04146bc37c13dd4654811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:43.895674 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.896367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-383674a0-c6a6-438b-b51e-a7dc0197f6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:43.898137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1140/2296] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:43 2022] DELETE /identity/v3/projects/1389a33065d04146bc37c13dd4654811 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:43.902787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:43.903302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:43.903412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:43.942764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:43.944622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:44.018387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1157/2297] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:44.026248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.026538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.026825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.048141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:44.053980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:44.062178 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1141/2298] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:06:44.066597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.076504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2cb3-9707-4ec9-94e7-105e2c267e6f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.081204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.081918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.082208 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.082485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.083229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:44.083538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.085659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.097559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1158/2299] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:44.102462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.111855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03149388-0ab7-432d-9411-ff1968815e84 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.117466 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.118127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.118464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.118745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.119720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.121684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.251172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1142/2300] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:44.255320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.265506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80f4a7-4e24-49b1-ab19-6df5ce3f9815 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.324253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.324973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.325261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.325540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.326230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.328166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.454994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1159/2301] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:44.459672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.470135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8566a-1f46-4ba4-9f94-c8d148357d5c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.475339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.476168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.476458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.476768 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.477507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.479148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.493081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1143/2302] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:44.495806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.506848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec23f5-7248-4aab-b533-18d4da4fe397 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.511578 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.512246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.512536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.512857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.513600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.515194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e888720-d397-491b-a5df-7eb54e499881 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.525672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1160/2303] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:44.530874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.541473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0206-038b-4e4e-8675-e47d119aadc8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.546275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.547169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.547456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.547738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] PATH_INFO: `/v3/projects/73a7d56b45cf44ee816d9c672812c1a7/users/acfc4c636fa64d9ea36b675ce3b61f9a/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.562691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a7d56b45cf44ee816d9c672812c1a7, user_id=acfc4c636fa64d9ea36b675ce3b61f9a, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.565440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.713289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1144/2304] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:44 2022] PUT /identity/v3/projects/73a7d56b45cf44ee816d9c672812c1a7/users/acfc4c636fa64d9ea36b675ce3b61f9a/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:44.724926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.725222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.725508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.751234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] MFA Rules not processed for user `acfc4c636fa64d9ea36b675ce3b61f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:44.762342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:44.778831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:44.815818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1161/2305] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:44.821023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:44.842372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:44.893723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e784ce-c058-4294-a432-2d7129635a8c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:44.899083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:44.899791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:44.900074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:44.900350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:44.901260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:44.903185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:44.993274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1145/2306] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:44.997581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.009193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db738e4-0fcc-4a9a-953f-35c3b94d4ff8 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.071103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.071789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.072078 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.072364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.073105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.075143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.165794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1162/2307] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:44 2022] POST /identity/v3/users => generated 306 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:06:45.172263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.182687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd98c6-4af5-42cc-96a3-6d62f89ff24e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.187368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.188135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.188428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.188746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.189483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.191093 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.203376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1146/2308] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:45.207597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.218553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d251-9433-44e3-9200-52c7cd75b39d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.223272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.224191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.225227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.225583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] PATH_INFO: `/v3/projects/14ea8df60e4047f4a04c9efb7626377a/users/15ea725f3123411eb346641c3ccc26f0/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.241713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea8df60e4047f4a04c9efb7626377a, user_id=15ea725f3123411eb346641c3ccc26f0, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.244842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.346944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1163/2309] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:45 2022] PUT /identity/v3/projects/14ea8df60e4047f4a04c9efb7626377a/users/15ea725f3123411eb346641c3ccc26f0/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:45.352267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.361555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c98c-f184-4d1c-93ec-688ef91ddd6a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.420455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.421212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.421500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.421769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.422533 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.424208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9227be-4ac4-477b-8a71-b76221ff1159 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.436591 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1147/2310] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:06:45.440786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.451836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523175-0431-4062-9608-e6cba0b1a201 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.456369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.457306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.457603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.457866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] PATH_INFO: `/v3/projects/14ea8df60e4047f4a04c9efb7626377a/users/15ea725f3123411eb346641c3ccc26f0/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.460820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea8df60e4047f4a04c9efb7626377a, user_id=15ea725f3123411eb346641c3ccc26f0, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.463521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.474722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1164/2311] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:45 2022] PUT /identity/v3/projects/14ea8df60e4047f4a04c9efb7626377a/users/15ea725f3123411eb346641c3ccc26f0/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:45.485174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.485595 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.485887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.513234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] MFA Rules not processed for user `15ea725f3123411eb346641c3ccc26f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:45.514370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:45.583577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1148/2312] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:45.595100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.596859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:45.656533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44878ed0-ce0d-42f9-8369-92d313b5bea1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.660284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.660981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.661270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.661552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.671421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:45.672880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5638-9b97-41b7-bcb1-4e817aeb1ab9 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:45.682857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1165/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:45.937341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:45.948142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a97bd-b008-41b7-9076-e9baec2095eb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:45.951834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:45.952632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:45.953029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:45.955000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:45.967927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:46.023914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:46.025592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:46.034846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1149/2314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:49.466531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:49.467001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:49.467193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:49.486118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:49.487370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:49.507426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:49.561806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1166/2315] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:49.566893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:49.568594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:49.638946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539284-b681-4ce8-b76f-1dfcc264afc1 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:49.644347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:49.645042 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:49.645332 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:49.645608 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:49.654552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:49.656153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238fadb-bcc5-437d-8db5-9525a363bf91 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:49.665080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1150/2316] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:51.171526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:51.242870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce11c77-7149-4071-8c06-6f3e7abd2be1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:51.248938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:51.249962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:51.250316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:51.250667 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] PATH_INFO: `/v3/users/acfc4c636fa64d9ea36b675ce3b61f9a` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:51.252104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfc4c636fa64d9ea36b675ce3b61f9a)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:51.254194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:51.459515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfc4c636fa64d9ea36b675ce3b61f9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:51.470274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfc4c636fa64d9ea36b675ce3b61f9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:51.471083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfc4c636fa64d9ea36b675ce3b61f9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:51.471768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfc4c636fa64d9ea36b675ce3b61f9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:51.563169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfc4c636fa64d9ea36b675ce3b61f9a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:51.582602 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1167/2317] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:51 2022] DELETE /identity/v3/users/acfc4c636fa64d9ea36b675ce3b61f9a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:51.587582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:51.588075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:51.588194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:51.606544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:51.608163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:51.676890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1151/2318] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:51.687463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:51.688961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:51.747511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:51.753371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518148fe-cb6b-42fc-a086-26bec875cf05 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:51.757871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:51.759346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:51.759346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:51.759346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:51.769921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:51.771450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:51.782251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1168/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:52.301522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:52.303792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:52.317018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab225fd-c4f2-4192-a1c0-71577fe571b9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:52.324196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:52.325822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:52.326318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:52.326805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] PATH_INFO: `/v3/projects/73a7d56b45cf44ee816d9c672812c1a7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:52.328289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a7d56b45cf44ee816d9c672812c1a7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:52.331555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:52.506639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:52.513590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a7d56b45cf44ee816d9c672812c1a7', 'request_id': 'req-7c01cec6-ca90-4c04-a00a-d9799493347e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.597361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a7d56b45cf44ee816d9c672812c1a7', 'request_id': 'req-7c01cec6-ca90-4c04-a00a-d9799493347e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.605128 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a7d56b45cf44ee816d9c672812c1a7', 'request_id': 'req-7c01cec6-ca90-4c04-a00a-d9799493347e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.615703 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] The token cache is being invalidate because project 73a7d56b45cf44ee816d9c672812c1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:52.615991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.616651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.621772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1152/2320] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:52 2022] DELETE /identity/v3/projects/73a7d56b45cf44ee816d9c672812c1a7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:52.623227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:52.640377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce22-8398-4ae9-ade5-32be0b6fb8b7 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:52.698987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:52.699884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:52.700216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:52.700492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] PATH_INFO: `/v3/users/15ea725f3123411eb346641c3ccc26f0` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:52.701754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ea725f3123411eb346641c3ccc26f0)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:52.703776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:52.888147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ea725f3123411eb346641c3ccc26f0'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.895222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ea725f3123411eb346641c3ccc26f0'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.896556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ea725f3123411eb346641c3ccc26f0'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.897422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ea725f3123411eb346641c3ccc26f0'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.969218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-56a8ced3-897f-4494-9e9d-69b7abb39a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ea725f3123411eb346641c3ccc26f0'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.990594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1169/2321] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:52 2022] DELETE /identity/v3/users/15ea725f3123411eb346641c3ccc26f0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:53.405899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.407363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:53.421496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cec6-ca90-4c04-a00a-d9799493347e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.486641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.487525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.487812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.488090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] PATH_INFO: `/v3/projects/14ea8df60e4047f4a04c9efb7626377a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.489342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ea8df60e4047f4a04c9efb7626377a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.492005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.585058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ea8df60e4047f4a04c9efb7626377a', 'request_id': 'req-2c41e28d-2682-4a17-86ba-4e36dce18b92'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.662015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ea8df60e4047f4a04c9efb7626377a', 'request_id': 'req-2c41e28d-2682-4a17-86ba-4e36dce18b92'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.671492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ea8df60e4047f4a04c9efb7626377a', 'request_id': 'req-2c41e28d-2682-4a17-86ba-4e36dce18b92'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.686554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] The token cache is being invalidate because project 14ea8df60e4047f4a04c9efb7626377a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:53.686929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.687604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2c41e28d-2682-4a17-86ba-4e36dce18b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.692736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1153/2322] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:53 2022] DELETE /identity/v3/projects/14ea8df60e4047f4a04c9efb7626377a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:53.694452 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.694934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.695044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.713692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:53.714990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:53.792525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1170/2323] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:53.804937 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.805252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.805562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.826967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:53.829063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:53.838183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1154/2324] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:53.842502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.853359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca836d-4408-437d-aeda-83dd4ecfe928 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.858063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.858737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.859027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.859307 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.860043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:53.860358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.862011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.864800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:53.876943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1171/2325] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:53.884278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.893715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97aec14-492a-475b-97ca-96d522ede51f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.899561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.900229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.900510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.900854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.901567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.903475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.017973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1155/2326] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:54.022496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.036295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6fa-0067-453d-ba0d-f6b8cb52ec4f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.096321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.097174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.097495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.097774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.098474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.101080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.172495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1172/2327] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:54 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:54.176716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.188899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3597-4f9c-4eb6-bfc1-67ddae24e2c8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.195565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.195761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.196195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.196478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.197541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.199670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.217040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1156/2328] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:54.225604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.238497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5569f4-1c97-47cc-8c6e-51c00d627c41 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.244764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.245442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.245755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.246032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.246772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.248565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6de74-5bd9-4022-9f3c-c0423420bfab admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.261093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1173/2329] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:54.265409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.275820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9bb0-e616-404f-9bf5-cfeae9d2514c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.280514 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.281439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.281723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.281997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] PATH_INFO: `/v3/projects/6b6dd22ecd0345319a12d160832ae745/users/644ae303f4894628860d85a7e4c66880/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.298909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6dd22ecd0345319a12d160832ae745, user_id=644ae303f4894628860d85a7e4c66880, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.301607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.304004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:54.386588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1157/2330] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:54 2022] PUT /identity/v3/projects/6b6dd22ecd0345319a12d160832ae745/users/644ae303f4894628860d85a7e4c66880/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:54.453006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.453322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.453605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.483526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] MFA Rules not processed for user `644ae303f4894628860d85a7e4c66880`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:54.484795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:54.554909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1174/2331] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:54.559405 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.625433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e342d3-dda1-4e20-8f3d-bd6728acf1a0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.630351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.633517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.633996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.634482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.635279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.637289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.772579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1158/2332] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:54 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:54.776750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.803685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ef385-42dd-47f6-8711-a8a19b34f24a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.871418 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.872297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.872698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.874198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.874923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.877270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.886727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:54.981179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1175/2333] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:54 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:54.985344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.997834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6238b8d-2d95-4a8f-b2bf-28b096278df6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.002837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.003515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.003799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.004075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.004848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.015783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.034273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1159/2334] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:55.038755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:55.049376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9330-a4ce-4a36-9c1b-b2c4d60040b8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.055522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.056513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.056812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.057089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] PATH_INFO: `/v3/projects/6cf10257d2104d43b06618b46928b2c2/users/17084ca9250f4fafb08522dca11e079e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.073045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf10257d2104d43b06618b46928b2c2, user_id=17084ca9250f4fafb08522dca11e079e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.075874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.148027 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1176/2335] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:55 2022] PUT /identity/v3/projects/6cf10257d2104d43b06618b46928b2c2/users/17084ca9250f4fafb08522dca11e079e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:55.152139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:55.163557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128512f-355f-407f-8ef7-01e25525482a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.229717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.230594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.230965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.234523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.234523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.234523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188b7f-f7d8-4328-8878-e7390ab485c4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.251963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1160/2336] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:06:55.253195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:55.264615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973455-9834-41ec-8922-ea8dc2b24b2d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.269910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.271922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.272405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.272898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] PATH_INFO: `/v3/projects/6cf10257d2104d43b06618b46928b2c2/users/17084ca9250f4fafb08522dca11e079e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.275144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf10257d2104d43b06618b46928b2c2, user_id=17084ca9250f4fafb08522dca11e079e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.278168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.290357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1177/2337] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:55 2022] PUT /identity/v3/projects/6cf10257d2104d43b06618b46928b2c2/users/17084ca9250f4fafb08522dca11e079e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:06:55.300458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.300778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.301183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.331628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] MFA Rules not processed for user `17084ca9250f4fafb08522dca11e079e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:55.332782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:55.387906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:55.407082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1161/2338] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:55.418740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:55.420469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:55.480171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f4b60-c0ce-43e4-ab4f-bcd21b600bbe admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.484174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.484871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.485156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.485456 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.497446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.499356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.510940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1178/2339] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:06:55.645663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:55.656541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cec3a-94a5-4350-a3cc-05d504887b44 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:55.660646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:55.661341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:55.661642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:55.661913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:55.729803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:55.731377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369728f-2045-419a-a2dd-0b2f4a6dd62a service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:55.742031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1162/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:56.376977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:56.443300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015291-80cd-47e4-8679-439427ea4ae3 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:56.448194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:56.449129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:56.449416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:56.449695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] PATH_INFO: `/v3/users/644ae303f4894628860d85a7e4c66880` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:56.450958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=644ae303f4894628860d85a7e4c66880)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:56.452956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:56.664430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644ae303f4894628860d85a7e4c66880'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:56.671884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644ae303f4894628860d85a7e4c66880'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:56.672570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644ae303f4894628860d85a7e4c66880'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:56.673213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644ae303f4894628860d85a7e4c66880'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:56.677860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:56.734540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644ae303f4894628860d85a7e4c66880'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:56.755721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1179/2341] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:56 2022] DELETE /identity/v3/users/644ae303f4894628860d85a7e4c66880 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:56.760758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:56.761294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:56.761447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:56.780741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:56.782073 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:56.846688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1163/2342] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:56.857053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:56.858564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:56.926461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af3f9-04d0-4989-a4b2-cf1b9c933efc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:56.930322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:56.930980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:56.931264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:56.931548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:56.943510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:56.945200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:56.955458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1180/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:57.503001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:57.505493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:57.528911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ee6d8-955d-4988-a5eb-be539665867c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:57.535079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:57.536108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:57.537103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:57.541948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] PATH_INFO: `/v3/projects/6b6dd22ecd0345319a12d160832ae745` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:57.541948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6dd22ecd0345319a12d160832ae745)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:57.541948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:57.659813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6dd22ecd0345319a12d160832ae745', 'request_id': 'req-b199261e-2070-4b16-9abd-4cb860fc9aa6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:57.741551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6dd22ecd0345319a12d160832ae745', 'request_id': 'req-b199261e-2070-4b16-9abd-4cb860fc9aa6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:57.749220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6dd22ecd0345319a12d160832ae745', 'request_id': 'req-b199261e-2070-4b16-9abd-4cb860fc9aa6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:57.761196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] The token cache is being invalidate because project 6b6dd22ecd0345319a12d160832ae745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:57.761859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:57.762536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:57.764646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1164/2344] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:57 2022] DELETE /identity/v3/projects/6b6dd22ecd0345319a12d160832ae745 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:57.768580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:57.781320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250a83-214b-46ff-a36c-48985da3afb9 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:57.850771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:57.851969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:57.852327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:57.852709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] PATH_INFO: `/v3/users/17084ca9250f4fafb08522dca11e079e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:57.854170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17084ca9250f4fafb08522dca11e079e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:57.856253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:58.030295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17084ca9250f4fafb08522dca11e079e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:58.038268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17084ca9250f4fafb08522dca11e079e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:58.039691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17084ca9250f4fafb08522dca11e079e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:58.040303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17084ca9250f4fafb08522dca11e079e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:58.106455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9af45855-6fba-462a-80b3-f5026350b64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17084ca9250f4fafb08522dca11e079e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:58.122661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:58.130184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1181/2345] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:57 2022] DELETE /identity/v3/users/17084ca9250f4fafb08522dca11e079e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:58.890129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:58.891596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:58.906445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199261e-2070-4b16-9abd-4cb860fc9aa6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:58.915570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:58.966417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:58.967296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:58.967585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:58.967868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] PATH_INFO: `/v3/projects/6cf10257d2104d43b06618b46928b2c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:58.969134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf10257d2104d43b06618b46928b2c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:58.971049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.142359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf10257d2104d43b06618b46928b2c2', 'request_id': 'req-41ba60a4-a925-40a1-87f0-19b9b6526f85'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:59.226303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf10257d2104d43b06618b46928b2c2', 'request_id': 'req-41ba60a4-a925-40a1-87f0-19b9b6526f85'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:59.233256 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf10257d2104d43b06618b46928b2c2', 'request_id': 'req-41ba60a4-a925-40a1-87f0-19b9b6526f85'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:59.245059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] The token cache is being invalidate because project 6cf10257d2104d43b06618b46928b2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:59.245355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:59.246084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-41ba60a4-a925-40a1-87f0-19b9b6526f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:59.251147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1165/2346] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:58 2022] DELETE /identity/v3/projects/6cf10257d2104d43b06618b46928b2c2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:59.253853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.259639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.259639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.279019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:59.280359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:59.345694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1182/2347] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:59.354451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.354748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.355015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.374788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:59.376130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:59.385020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1166/2348] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:59.389406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.400160 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1db52-14a8-47dd-885b-16d6383b4a57 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.404857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.405541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.405827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.406104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.406845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:59.407156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.408802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.422292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1183/2349] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:59.427712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.437198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d04d-e101-440a-8bdf-277ecc2d7aa3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.441969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.446848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.446848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.446848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.446848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.446848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.543045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1167/2350] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:59 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:59.547995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.563987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137922f8-e7c9-4f87-a59d-52fe2b49041e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.623922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.624603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.625082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.625367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.626088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.627994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.719689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1184/2351] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:59 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:59.722764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.734486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c39bb-539a-4d52-bdcf-e9a5044f026f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.740733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.741397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.741681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.741957 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.742709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.744580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.760586 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1168/2352] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:06:59.761845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.771976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c263-0e6a-4bd2-ab88-13c53f178ac5 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.776725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.777397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.777718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.777998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.780798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.780798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21328ed8-1736-49fb-b606-3d96aaab7d18 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:59.794680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1185/2353] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:59.796040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:59.808063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66e43-38a2-4ec6-b7bb-4e604e532be4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:59.813231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:59.814197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:59.814485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:59.814758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] PATH_INFO: `/v3/projects/8d8f67105cd744e597f896caf8ad352f/users/02195239475944e895bceb92a416b0fa/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:59.833538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8f67105cd744e597f896caf8ad352f, user_id=02195239475944e895bceb92a416b0fa, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:59.837119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:00.045749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1169/2354] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:59 2022] PUT /identity/v3/projects/8d8f67105cd744e597f896caf8ad352f/users/02195239475944e895bceb92a416b0fa/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:00.057834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:00.058129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:00.058477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:00.085920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] MFA Rules not processed for user `02195239475944e895bceb92a416b0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:00.087124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:00.142849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:00.152608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1186/2355] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:00.164406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:00.166135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:00.207408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:00.222876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17e48c-71bd-44c6-802f-fb478f188a40 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:00.226892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:00.227543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:00.227829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:00.228108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:00.236416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:00.237886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f4138-8622-4a30-8c19-49b0818c4ac4 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:00.247524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1170/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:05.516371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:05.579042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6562-a94a-4246-a60c-30db8bf4d83d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:05.584095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:05.585045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:05.585328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:05.585605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] PATH_INFO: `/v3/users/02195239475944e895bceb92a416b0fa` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:05.586933 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02195239475944e895bceb92a416b0fa)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:05.588889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:05.783316 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02195239475944e895bceb92a416b0fa'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:05.790654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02195239475944e895bceb92a416b0fa'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:05.791314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02195239475944e895bceb92a416b0fa'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:05.791919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02195239475944e895bceb92a416b0fa'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:05.888543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02195239475944e895bceb92a416b0fa'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:05.906979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1187/2357] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:05 2022] DELETE /identity/v3/users/02195239475944e895bceb92a416b0fa => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:05.912508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:05.913024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:05.913131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:05.930092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:05.931370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:05.990927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1171/2358] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:06.000900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:06.002364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:06.065870 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae300fd-50ef-4a3e-ae61-6f397a2226e9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:06.069956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:06.070661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:06.070988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:06.071325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:06.081868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:06.083879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e697-2e56-4081-a6dc-f2d2c86b4387 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:06.093819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1188/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:06.622201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:06.623689 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:06.637353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289d9b0-7bf9-410e-970d-fe4055e7202b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:06.642040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:06.642916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:06.643195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:06.643470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] PATH_INFO: `/v3/projects/8d8f67105cd744e597f896caf8ad352f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:06.644822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8f67105cd744e597f896caf8ad352f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:06.647790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:06.763173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8f67105cd744e597f896caf8ad352f', 'request_id': 'req-d32f2bbb-4d32-43e5-9bec-1832f073f63a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:06.831737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8f67105cd744e597f896caf8ad352f', 'request_id': 'req-d32f2bbb-4d32-43e5-9bec-1832f073f63a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:06.840159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8f67105cd744e597f896caf8ad352f', 'request_id': 'req-d32f2bbb-4d32-43e5-9bec-1832f073f63a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:06.853388 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] The token cache is being invalidate because project 8d8f67105cd744e597f896caf8ad352f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:06.853813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:06.854573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d32f2bbb-4d32-43e5-9bec-1832f073f63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:06.856411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1172/2360] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:06 2022] DELETE /identity/v3/projects/8d8f67105cd744e597f896caf8ad352f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:07:06.861513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:06.862030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:06.862148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:06.886241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:06.888774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:06.908494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:06.971441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1189/2361] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:06.980342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:06.980911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:06.981328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.004550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:07.006610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:07.020812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1173/2362] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:07.021902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.032131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823f47a-9898-401e-aa16-4db439dfbdca None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.038805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.039712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.043952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.043952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.043952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:07.043952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.043952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.056565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1190/2363] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:07:07.060830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.070490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39795687-3dd3-4d65-b919-56621e99e51d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.075506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.076194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.076479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.076789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.077510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.079451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.170879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1174/2364] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:07 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:07.174968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.185746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fa061-30d8-44fe-aed8-825100322028 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.250035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.250707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.250997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.251276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.251974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.253938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.390337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1191/2365] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:07 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:07.390518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.401691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746251-dc5f-427f-957f-e538fd9e4a6f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.406236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.406897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.407182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.407505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.408255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.409893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.420289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1175/2366] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:07.424384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.434979 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15ab7c-5110-4299-a645-8d6e2358b8c7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.439555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.440210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.440490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.440796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.441551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.443910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda06d-bade-4c59-8e3c-bb77fc084753 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.454106 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1192/2367] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:07.458182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.468147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c040a-eb9b-4f00-83b7-c8b46438414b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.472905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.473949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.474267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.474547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] PATH_INFO: `/v3/projects/f0887d0bda004f24aed7b2f14d0c5fc5/users/2b6a0c5f8ff943d8a702b2fbec75d073/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.490800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0887d0bda004f24aed7b2f14d0c5fc5, user_id=2b6a0c5f8ff943d8a702b2fbec75d073, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.501035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.599628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:07.606175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1176/2368] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:07 2022] PUT /identity/v3/projects/f0887d0bda004f24aed7b2f14d0c5fc5/users/2b6a0c5f8ff943d8a702b2fbec75d073/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:07.622130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b7ed-3518-425d-8a7d-23255c177bc6 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.622502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b7ed-3518-425d-8a7d-23255c177bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.622850 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b7ed-3518-425d-8a7d-23255c177bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.651513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2d86b7ed-3518-425d-8a7d-23255c177bc6 None None] MFA Rules not processed for user `2b6a0c5f8ff943d8a702b2fbec75d073`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:07.652797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2d86b7ed-3518-425d-8a7d-23255c177bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:07.720562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1193/2369] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:07.733237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:07.734966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:07.796384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b454-501e-4597-a7dd-18e2a1d95360 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:07.800364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:07.801066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:07.801357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:07.801780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:07.810325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:07.811766 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:07.821009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1177/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:11.161776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:11.162324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:11.162324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:11.180331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:11.181550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:11.190304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:11.243055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1194/2371] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:11.256034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:11.257745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:11.327486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050503-fa48-4b93-a157-dabc274f8e16 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:11.332441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:11.333167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:11.333448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:11.333722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:11.341887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:11.343772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21eae3-b5d9-4059-847c-2a9870e282d2 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:11.352440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1178/2372] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:07:15.072697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:15.133988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5252d-7eff-48c1-b4a7-dd62abf92b7a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:15.138509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:15.139428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:15.139661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:15.139938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] PATH_INFO: `/v3/users/2b6a0c5f8ff943d8a702b2fbec75d073` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:15.141145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6a0c5f8ff943d8a702b2fbec75d073)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:15.143075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:15.405704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6a0c5f8ff943d8a702b2fbec75d073'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:15.414014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6a0c5f8ff943d8a702b2fbec75d073'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:15.414717 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6a0c5f8ff943d8a702b2fbec75d073'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:15.415332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6a0c5f8ff943d8a702b2fbec75d073'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:15.482751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6a0c5f8ff943d8a702b2fbec75d073'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:15.506011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1195/2373] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:15 2022] DELETE /identity/v3/users/2b6a0c5f8ff943d8a702b2fbec75d073 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:15.510557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:15.511086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:15.511195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:15.528530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:15.529781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:15.596407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1179/2374] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:15.607144 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:15.608696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:15.653563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:15.669673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013960-7566-401b-b61e-74a5763c9acc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:15.673338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:15.673971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:15.674252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:15.674527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:15.684272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:15.687244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:15.695188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1196/2375] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:16.078611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:16.080392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:16.094310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14e793-5570-4c25-95e6-a8b11801dab5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:16.099796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:16.100749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:16.101195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:16.101336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] PATH_INFO: `/v3/projects/f0887d0bda004f24aed7b2f14d0c5fc5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:16.102611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0887d0bda004f24aed7b2f14d0c5fc5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:16.104664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:16.200735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:16.221144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0887d0bda004f24aed7b2f14d0c5fc5', 'request_id': 'req-1010f015-9be2-4432-b836-07590becff8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:16.357765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0887d0bda004f24aed7b2f14d0c5fc5', 'request_id': 'req-1010f015-9be2-4432-b836-07590becff8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:16.366762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0887d0bda004f24aed7b2f14d0c5fc5', 'request_id': 'req-1010f015-9be2-4432-b836-07590becff8c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:16.387228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] The token cache is being invalidate because project f0887d0bda004f24aed7b2f14d0c5fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:16.387524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:16.391004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:16.391664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1180/2376] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:16 2022] DELETE /identity/v3/projects/f0887d0bda004f24aed7b2f14d0c5fc5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:23.640350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:23.641802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:23.653152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098f051-e914-460e-99e0-f38f2205c777 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:23.701932 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:23.702577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:23.702861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:23.703136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:23.704978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:23.766257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:23.767671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:23.777534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1197/2377] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:26.383399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:27.402811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:27.404410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:27.420626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f015-9be2-4432-b836-07590becff8c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:27.425474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:27.426494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:27.426794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:27.427072 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] PATH_INFO: `/v3/users/faa03e9023bb4b7a84cee7fa85bcf1aa` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:27.428907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa03e9023bb4b7a84cee7fa85bcf1aa)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:27.430972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:27.588200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa03e9023bb4b7a84cee7fa85bcf1aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:27.588879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa03e9023bb4b7a84cee7fa85bcf1aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:27.589519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa03e9023bb4b7a84cee7fa85bcf1aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:27.596546 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa03e9023bb4b7a84cee7fa85bcf1aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:27.676303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c1999fe3-3d97-49f4-9595-9bff256d28f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa03e9023bb4b7a84cee7fa85bcf1aa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:27.694363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1181/2378] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:27 2022] DELETE /identity/v3/users/faa03e9023bb4b7a84cee7fa85bcf1aa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:27.918868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:27.930771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd903d-998a-4824-8b7c-592ca527006a service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:27.988388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:27.989283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:27.989569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:27.989847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] PATH_INFO: `/v3/projects/5ec2898bd89643eb8ad3f2a9bb1aac40` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:27.991073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec2898bd89643eb8ad3f2a9bb1aac40)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:27.993014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.105567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:28.116906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec2898bd89643eb8ad3f2a9bb1aac40', 'request_id': 'req-d9730142-c5eb-41eb-9c83-b4faf04f2fce'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:28.190530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec2898bd89643eb8ad3f2a9bb1aac40', 'request_id': 'req-d9730142-c5eb-41eb-9c83-b4faf04f2fce'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:28.197804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec2898bd89643eb8ad3f2a9bb1aac40', 'request_id': 'req-d9730142-c5eb-41eb-9c83-b4faf04f2fce'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:28.208841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] The token cache is being invalidate because project 5ec2898bd89643eb8ad3f2a9bb1aac40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:28.209130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:28.210732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d9730142-c5eb-41eb-9c83-b4faf04f2fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:28.212323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1198/2379] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:27 2022] DELETE /identity/v3/projects/5ec2898bd89643eb8ad3f2a9bb1aac40 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:28.217445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.217743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.218022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.235582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:28.236825 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:28.295815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1182/2380] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:28.304246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.304541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.304892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.324190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:28.325429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:28.333324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1199/2381] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:28.338724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.348324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375e143-23e2-4c89-97e3-617278e0ac61 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.353547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.354202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.354486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.354761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.355485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:28.355789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.357433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.370074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1183/2382] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:28.374433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.384524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914af7-7fbc-4f2d-8e60-94c3271f9f57 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.389322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.389978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.390267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.390549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.391252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.393193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.529671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1200/2383] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:28 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:28.533736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.544190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fcd4-a2f4-412c-aba1-238e32473545 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.603576 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.604264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.604556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.604871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.605582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.607530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.614475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:28.722763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1184/2384] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:28 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:28.727477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.737796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9508-d55b-4343-a883-561d81c1ced7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.743549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.744209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.744948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.745228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.745963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.747554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.758255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1201/2385] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:28.764893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.775043 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bfb90-ceef-4ca3-a7e4-1b689b4d606e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.779583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.780292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.780524 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.780829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.781558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.783145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118eac19-f8f4-4e8c-b0e3-753fc21a54ca admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.794348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1185/2386] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:28.798463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:28.809181 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d475-6a3c-461b-a253-c4ce59c722cf admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:28.814070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:28.814949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.815259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.815534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] PATH_INFO: `/v3/projects/5c56d561ef18494a92369244e0e33589/users/e0c0f44d708f44dfa474c59861cbae5e/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.831067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56d561ef18494a92369244e0e33589, user_id=e0c0f44d708f44dfa474c59861cbae5e, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:28.833739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:28.910442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1202/2387] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:28 2022] PUT /identity/v3/projects/5c56d561ef18494a92369244e0e33589/users/e0c0f44d708f44dfa474c59861cbae5e/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:07:28.921443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:28.921735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:28.922015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:28.948554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] MFA Rules not processed for user `e0c0f44d708f44dfa474c59861cbae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:28.949847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:29.013508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1186/2388] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:29.024725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:29.026533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:29.099309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa543d-c0b6-4432-8e70-63f36c35f0e4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:29.105813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:29.106462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:29.106745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:29.107019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:29.114786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:29.116518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7227-f3cd-41ae-a43b-8ddec085a725 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:29.125609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1203/2389] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:07:35.187880 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:35.249906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e28f3-32fa-4a75-91f7-ae364feeedbf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:35.254495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:35.255372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:35.255651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:35.256647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] PATH_INFO: `/v3/users/e0c0f44d708f44dfa474c59861cbae5e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:35.257953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c0f44d708f44dfa474c59861cbae5e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:35.259873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:35.478105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c0f44d708f44dfa474c59861cbae5e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:35.478763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c0f44d708f44dfa474c59861cbae5e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:35.479372 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c0f44d708f44dfa474c59861cbae5e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:35.486726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c0f44d708f44dfa474c59861cbae5e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:35.556079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c0f44d708f44dfa474c59861cbae5e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:35.561469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:35.573338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1187/2390] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:35 2022] DELETE /identity/v3/users/e0c0f44d708f44dfa474c59861cbae5e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:35.577838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:35.578297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:35.578432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:35.595489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:35.596711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:35.636055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:35.656434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1204/2391] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:35.666712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:35.668118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:35.725234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532db88-c3c5-4308-bec6-21130f0db7e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:35.728995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:35.729584 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:35.729898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:35.730175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:35.739087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:35.741285 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ee5ef-6226-490e-a8c7-ea33c2d0d61c service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:35.751142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1188/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:36.146236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.149730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:36.160426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea231-af0b-4146-bdd0-fe42c22aafaa None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.165869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.166798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.167089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.167373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] PATH_INFO: `/v3/projects/5c56d561ef18494a92369244e0e33589` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.168582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56d561ef18494a92369244e0e33589)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.170571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.293692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56d561ef18494a92369244e0e33589', 'request_id': 'req-c1299ad9-5f83-46d9-b528-57060872eb66'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:36.373512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56d561ef18494a92369244e0e33589', 'request_id': 'req-c1299ad9-5f83-46d9-b528-57060872eb66'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:36.380148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56d561ef18494a92369244e0e33589', 'request_id': 'req-c1299ad9-5f83-46d9-b528-57060872eb66'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:36.391194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] The token cache is being invalidate because project 5c56d561ef18494a92369244e0e33589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:36.391483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:36.392114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-c1299ad9-5f83-46d9-b528-57060872eb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:36.393687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1205/2393] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:36 2022] DELETE /identity/v3/projects/5c56d561ef18494a92369244e0e33589 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:36.399287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.399762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.399860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.417476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:36.418969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:36.478974 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1189/2394] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:36.486507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.486836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.487119 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.506325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:36.507462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:36.515366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1206/2395] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:36.519438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.529708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67ee28-2f28-4cab-b888-0f3f3c9bec9b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.534478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.535140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.535429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.535709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.536444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:36.536791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.538477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.550030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1190/2396] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:36.553972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.563510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb78731-873c-4881-b93f-e7ae417b8374 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.568195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.569411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.569698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.569976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.570662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.572568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.665753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1207/2397] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:36 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:36.670168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.680944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce997b-6acb-447a-89de-ce5b0626609f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.736155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.736859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.737152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.737433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.738137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.740055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.831593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1191/2398] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:36 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:07:36.836089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.846629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a56b8-c530-442a-9cdf-c1771077b8fb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.851313 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.851980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.852265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.852544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.853347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.855039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.865914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1208/2399] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:36.873652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.884698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537deee-2027-46f8-b3b3-d28499dca243 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.889440 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.890101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.890385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.890663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.891395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.893052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987c00-4ca0-4d1e-ac30-feb3205fa93b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:36.894329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:36.904282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1192/2400] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:36.908493 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:36.918607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c59113-0b0e-46c7-a9d5-151c5cc78f8a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:36.923223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:36.924101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:36.924380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:36.924654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] PATH_INFO: `/v3/projects/ebb5c81cad994b42b744f72dd0572c21/users/5fe8e97bbbad4e99b92b40c540ae4fd9/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:36.940286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb5c81cad994b42b744f72dd0572c21, user_id=5fe8e97bbbad4e99b92b40c540ae4fd9, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:36.942962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.042948 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1209/2401] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:36 2022] PUT /identity/v3/projects/ebb5c81cad994b42b744f72dd0572c21/users/5fe8e97bbbad4e99b92b40c540ae4fd9/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:37.055135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.055428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.055708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.082498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] MFA Rules not processed for user `5fe8e97bbbad4e99b92b40c540ae4fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:37.083639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:37.145931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1193/2402] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:37.153180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.215885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7073c-d934-40d9-97ac-7981c5b5fb23 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.220875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.221571 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.221857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.222137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.222834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.225352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.229433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:37.306188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1210/2403] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:37 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:37.310244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.321349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f48a-b7dd-48d6-b9a2-c0017aa4cdeb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.377972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.378717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.379003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.379279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.380022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.382016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.470809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1194/2404] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:37 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:37.475198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.485551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d186-95e7-432d-b725-80bd54335632 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.490605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.491548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.491832 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.492105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.492878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.494715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.505123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1211/2405] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:37.509964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.520009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d05483-3861-4a1d-8b08-000802083c4b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.527221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.528138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.528427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.528743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] PATH_INFO: `/v3/projects/d117026d00394451a788eae8864156ca/users/daa05423fb6d43739278ba6f93e082bd/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.544348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117026d00394451a788eae8864156ca, user_id=daa05423fb6d43739278ba6f93e082bd, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.547201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.625558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1195/2406] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:37 2022] PUT /identity/v3/projects/d117026d00394451a788eae8864156ca/users/daa05423fb6d43739278ba6f93e082bd/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:37.629474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.639549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae255-20e9-4c65-bb8e-91c82d7e2a24 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.696327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.697017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.697297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.697574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.698293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.699880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2644b-ba6d-4127-8184-38331fada5e1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.710422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1212/2407] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:37.714722 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.725686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bdd3e-0e9c-4fab-968a-a4f15811ec2d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.730316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.731196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.731478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.731755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] PATH_INFO: `/v3/projects/d117026d00394451a788eae8864156ca/users/daa05423fb6d43739278ba6f93e082bd/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.733782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117026d00394451a788eae8864156ca, user_id=daa05423fb6d43739278ba6f93e082bd, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.736422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.746958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1196/2408] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:37 2022] PUT /identity/v3/projects/d117026d00394451a788eae8864156ca/users/daa05423fb6d43739278ba6f93e082bd/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:37.757540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.757830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.758109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.784241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] MFA Rules not processed for user `daa05423fb6d43739278ba6f93e082bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:37.785467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:37.850293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1213/2409] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:37.861480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:37.863255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:37.907319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:37.922091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ed84-3754-4eac-8c7d-a2f5703fe10c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:37.925807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:37.926461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:37.926752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:37.927035 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:37.936383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:37.937869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac6aa-6617-4008-93ce-b198636401a1 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:37.948106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1197/2410] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:38.945018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:39.004124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:39.008345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fbca0-f0fe-4bde-93a5-8db7c8431e8b None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:39.012968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:39.013849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:39.014133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:39.014688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] PATH_INFO: `/v3/users/5fe8e97bbbad4e99b92b40c540ae4fd9` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:39.015886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe8e97bbbad4e99b92b40c540ae4fd9)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:39.017860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:39.260049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe8e97bbbad4e99b92b40c540ae4fd9'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:39.266873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe8e97bbbad4e99b92b40c540ae4fd9'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:39.267532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe8e97bbbad4e99b92b40c540ae4fd9'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:39.268135 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe8e97bbbad4e99b92b40c540ae4fd9'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:39.378842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe8e97bbbad4e99b92b40c540ae4fd9'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:39.396336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1214/2411] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:38 2022] DELETE /identity/v3/users/5fe8e97bbbad4e99b92b40c540ae4fd9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:39.401248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:39.401735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:39.401969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:39.419926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:39.421171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:39.478368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1198/2412] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:39.487953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:39.489417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:39.549913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d03f13-2633-4122-864f-a767d773e531 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:39.554041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:39.554684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:39.554967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:39.555243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:39.564139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:39.565589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:39.575257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1215/2413] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:40.038544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:40.040064 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:40.056468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e950e-bd89-4804-8e3a-47a0d10cb22f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:40.063003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:40.063922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:40.064185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:40.064473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] PATH_INFO: `/v3/projects/ebb5c81cad994b42b744f72dd0572c21` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:40.065863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb5c81cad994b42b744f72dd0572c21)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:40.067794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:40.173822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb5c81cad994b42b744f72dd0572c21', 'request_id': 'req-b27cdf4f-06cd-440c-92f6-2a959bb3f947'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.230588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb5c81cad994b42b744f72dd0572c21', 'request_id': 'req-b27cdf4f-06cd-440c-92f6-2a959bb3f947'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.237148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb5c81cad994b42b744f72dd0572c21', 'request_id': 'req-b27cdf4f-06cd-440c-92f6-2a959bb3f947'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.248924 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] The token cache is being invalidate because project ebb5c81cad994b42b744f72dd0572c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:40.249215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.249847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.251417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1199/2414] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:40 2022] DELETE /identity/v3/projects/ebb5c81cad994b42b744f72dd0572c21 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:40.255423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:40.266532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b338d-9f70-4693-ad33-acc1b409a287 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:40.329626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:40.330635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:40.331020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:40.331342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] PATH_INFO: `/v3/users/daa05423fb6d43739278ba6f93e082bd` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:40.332702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa05423fb6d43739278ba6f93e082bd)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:40.336209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:40.360096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:40.615348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa05423fb6d43739278ba6f93e082bd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.626249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa05423fb6d43739278ba6f93e082bd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.632864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa05423fb6d43739278ba6f93e082bd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.632864 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa05423fb6d43739278ba6f93e082bd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.733506 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-005f9ae6-e9a1-4579-8b4c-92589d6de89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa05423fb6d43739278ba6f93e082bd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:40.751211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1216/2415] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:40 2022] DELETE /identity/v3/users/daa05423fb6d43739278ba6f93e082bd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:41.236307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:41.236307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:41.249958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdf4f-06cd-440c-92f6-2a959bb3f947 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:41.310075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:41.310938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.311219 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.311494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] PATH_INFO: `/v3/projects/d117026d00394451a788eae8864156ca` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.312693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d117026d00394451a788eae8864156ca)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:41.314592 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:41.321954 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:41.430971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd117026d00394451a788eae8864156ca', 'request_id': 'req-cbc8752c-4059-4bcd-90af-653d0f649a72'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:41.539479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd117026d00394451a788eae8864156ca', 'request_id': 'req-cbc8752c-4059-4bcd-90af-653d0f649a72'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:41.546054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd117026d00394451a788eae8864156ca', 'request_id': 'req-cbc8752c-4059-4bcd-90af-653d0f649a72'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:41.557537 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] The token cache is being invalidate because project d117026d00394451a788eae8864156ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:41.578058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:41.578058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cbc8752c-4059-4bcd-90af-653d0f649a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:41.578058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1200/2416] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:41 2022] DELETE /identity/v3/projects/d117026d00394451a788eae8864156ca => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:41.578382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.578382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.578382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.582831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:41.584343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:41.643947 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1217/2417] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:41.653335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.653836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.654118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.673517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:41.674726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:41.684065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1201/2418] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:41.696222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:41.706228 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db21cc-3a38-417e-93f9-98fdf53d5dec None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:41.710940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:41.711605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.711894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.712178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.712943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:41.713256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:41.714905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:41.727197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1218/2419] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:41.731368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:41.740544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5fdba-7412-4bba-aa08-0f4c7d95d8f0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:41.746079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:41.746724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.747008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.747281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.747982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:41.749898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:41.842662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1202/2420] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:41 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:07:41.846527 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:41.857299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5462e1-bcce-4759-9a94-ecc30edf3ac9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:41.912514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:41.913926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:41.914207 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:41.914481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:41.915170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:41.917118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.043665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1219/2421] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:41 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:42.047571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.058274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab65c8-d793-4dad-9cbc-a3c8e8bf8465 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.062832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.063612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.063892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.064166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.064930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.066520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.077945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1203/2422] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:42.082107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.092554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28760ef-3bc9-4c28-89e9-c9b146b43a4c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.097256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.097851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.098139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.098416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.099146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.101535 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c269-63ae-49a3-87a0-d2d33e3e41e4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.111213 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1220/2423] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:42.115137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.125247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c28b00-c8e0-4d10-ae8b-c8fecb732087 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.129756 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.130634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.130915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.131192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] PATH_INFO: `/v3/projects/9ba52c96529d401a848dd72316472385/users/dd47140e3a254bb09a83d52aed3a5cc1/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.146426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba52c96529d401a848dd72316472385, user_id=dd47140e3a254bb09a83d52aed3a5cc1, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.149708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.219137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1204/2424] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:42 2022] PUT /identity/v3/projects/9ba52c96529d401a848dd72316472385/users/dd47140e3a254bb09a83d52aed3a5cc1/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:42.229759 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.230057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.230356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.237064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:42.257216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] MFA Rules not processed for user `dd47140e3a254bb09a83d52aed3a5cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:42.258426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:42.323254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1221/2425] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:42.327906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.388811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb0b2-f580-4376-9452-3e28541d5275 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.393490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.394153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.394443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.394731 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.395431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.397990 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.517411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1205/2426] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:42 2022] POST /identity/v3/projects => generated 391 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:42.521415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.532898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee3f3d-d185-4c6f-a20d-0172d80f6557 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.589586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.590258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.590542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.590814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.591509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.593465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.722128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1222/2427] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:42 2022] POST /identity/v3/users => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:42.726675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.737307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cee3-680b-4a4b-a410-eae3a49ed61c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.742637 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.743349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.743670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.743949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.744970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.746663 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.758401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1206/2428] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:42.762500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.778094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f324-52a9-43ce-8e2c-27af905952e1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.782719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.783611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.783902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.784187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] PATH_INFO: `/v3/projects/57f532611e3945769f2b27cc811e8a43/users/34df506ac98249759a87ba9effe260b6/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.798930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f532611e3945769f2b27cc811e8a43, user_id=34df506ac98249759a87ba9effe260b6, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.801749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.889532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1223/2429] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:42 2022] PUT /identity/v3/projects/57f532611e3945769f2b27cc811e8a43/users/34df506ac98249759a87ba9effe260b6/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:42.893724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.900244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:42.904111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba245f-337f-4f02-8e22-986161ba8560 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.958631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.959307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.959616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.960001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.960782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.962393 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2d979-1984-4b5b-a1a1-63a497615770 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:42.971838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1207/2430] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:42.976725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:42.987089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0123a-46ae-48e3-b15c-c58b657de1ab admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:42.992325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:42.993248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:42.993534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:42.993811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] PATH_INFO: `/v3/projects/57f532611e3945769f2b27cc811e8a43/users/34df506ac98249759a87ba9effe260b6/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:42.996055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f532611e3945769f2b27cc811e8a43, user_id=34df506ac98249759a87ba9effe260b6, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:42.998739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:43.009435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1224/2431] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:42 2022] PUT /identity/v3/projects/57f532611e3945769f2b27cc811e8a43/users/34df506ac98249759a87ba9effe260b6/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:43.019704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:43.020002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:43.020271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:43.047216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] MFA Rules not processed for user `34df506ac98249759a87ba9effe260b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:43.048471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:43.117476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1208/2432] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:43.128253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:43.129967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:43.181857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:43.187004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429556-2b38-40ee-9a04-abcbbb1faeb8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:43.191114 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:43.191842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:43.192128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:43.192406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:43.201736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:43.203179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:43.212844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1225/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:43.260117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:43.261649 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:43.275519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baee8d-863a-4366-bf0b-3e603ec515a6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:43.279183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:43.279913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:43.280199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:43.280477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:43.337224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:43.338678 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145ae5c-238e-4132-8d10-df176f9a2a62 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:43.347404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1209/2434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:49.392286 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:49.457920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f37e7-394d-4943-90e8-60b5ed613f5d service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:49.462697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:49.463567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:49.463849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:49.464128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] PATH_INFO: `/v3/users/dd47140e3a254bb09a83d52aed3a5cc1` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:49.465373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd47140e3a254bb09a83d52aed3a5cc1)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:49.467294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:49.702624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd47140e3a254bb09a83d52aed3a5cc1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.711191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd47140e3a254bb09a83d52aed3a5cc1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.711885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd47140e3a254bb09a83d52aed3a5cc1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.712494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd47140e3a254bb09a83d52aed3a5cc1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.800970 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd47140e3a254bb09a83d52aed3a5cc1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.836354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1226/2435] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:49 2022] DELETE /identity/v3/users/dd47140e3a254bb09a83d52aed3a5cc1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:49.841115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:49.841619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:49.841715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:49.860212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:49.861646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:49.883670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:49.924215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1210/2436] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:49.935137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:49.936695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:49.995809 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd9dab-874e-414b-85af-884a51cc509c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:49.999416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.000068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.000357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.000679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.009918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.011358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.021492 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1227/2437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:50.587129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.588734 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:50.602262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2352f-126a-47bc-942d-94f11c3e7f3f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.607000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.607877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.608158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.608458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] PATH_INFO: `/v3/projects/9ba52c96529d401a848dd72316472385` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.609752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba52c96529d401a848dd72316472385)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.611598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.837400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba52c96529d401a848dd72316472385', 'request_id': 'req-50640588-8c14-4f46-92ed-76c2881206b5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.949934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba52c96529d401a848dd72316472385', 'request_id': 'req-50640588-8c14-4f46-92ed-76c2881206b5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.956929 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba52c96529d401a848dd72316472385', 'request_id': 'req-50640588-8c14-4f46-92ed-76c2881206b5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.967257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] The token cache is being invalidate because project 9ba52c96529d401a848dd72316472385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:50.967550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.968183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.969778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1211/2438] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:50 2022] DELETE /identity/v3/projects/9ba52c96529d401a848dd72316472385 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:50.973723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.983430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3494b7-3407-4e63-aa50-04c7699e9b41 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.991702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:51.042196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:51.043075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:51.043355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:51.043635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] PATH_INFO: `/v3/users/34df506ac98249759a87ba9effe260b6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:51.044849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34df506ac98249759a87ba9effe260b6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:51.046772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:51.381973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34df506ac98249759a87ba9effe260b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.388548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34df506ac98249759a87ba9effe260b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.391051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34df506ac98249759a87ba9effe260b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.391051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34df506ac98249759a87ba9effe260b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.493941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b06461b7-758a-4869-b9c5-a15f5377e882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34df506ac98249759a87ba9effe260b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.511924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1228/2439] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:50 2022] DELETE /identity/v3/users/34df506ac98249759a87ba9effe260b6 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:51.957981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:51.959455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:51.976090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640588-8c14-4f46-92ed-76c2881206b5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.039011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.039883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.040161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.040430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] PATH_INFO: `/v3/projects/57f532611e3945769f2b27cc811e8a43` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.041668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f532611e3945769f2b27cc811e8a43)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.043565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.157396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f532611e3945769f2b27cc811e8a43', 'request_id': 'req-c5cbf580-f08b-46da-a064-a4a8e1a20441'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.159062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:52.252430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f532611e3945769f2b27cc811e8a43', 'request_id': 'req-c5cbf580-f08b-46da-a064-a4a8e1a20441'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.259890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f532611e3945769f2b27cc811e8a43', 'request_id': 'req-c5cbf580-f08b-46da-a064-a4a8e1a20441'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.270331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] The token cache is being invalidate because project 57f532611e3945769f2b27cc811e8a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:52.270618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.271275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5cbf580-f08b-46da-a064-a4a8e1a20441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.272854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1212/2440] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:51 2022] DELETE /identity/v3/projects/57f532611e3945769f2b27cc811e8a43 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:07:52.278596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.279069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.279227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.297902 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:52.304984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:52.361416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1229/2441] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:52.371037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.373688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.373688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.390642 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:52.391847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:52.400024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1213/2442] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:52.404284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.414251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc1a5-945f-4637-a748-b2bf8edd2f59 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.418876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.419547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.419834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.420112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.420883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:52.421200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.422937 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.435540 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1230/2443] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:52.439956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.451002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed80bd-f1d7-4cb8-b27f-10244a71571d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.455802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.456460 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.456839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.457123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.457841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.459762 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.622843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1214/2444] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/projects => generated 407 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:07:52.624336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.635337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a4804-f97b-4dee-b0b4-2551bcaaf090 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.647737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:52.693311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.693989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.694279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.694561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.695252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.697276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.863589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1231/2445] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/users => generated 304 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:52.864950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.876529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4dfdd-0827-4eee-b8c7-253296a7eaa5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.881236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.881917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.882201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.882480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.883274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.884999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.897010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1215/2446] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:52.905980 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.917054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f716a-7327-4ace-9d60-ac1b562cec3b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.922137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.922814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.923102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.923383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.924116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.925808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f62b1d-a0d6-46d3-96c6-d8b562a76ba8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.936830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1232/2447] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:52.941020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.951106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9cce4-9593-4c2c-9c57-317c940f11cd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.960419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.961501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.961777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.962048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] PATH_INFO: `/v3/projects/4e25a2f6c3f442ef83739e47c7f59ded/users/e3be64e9558a4acab8ea53d79dc639e1/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.977473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e25a2f6c3f442ef83739e47c7f59ded, user_id=e3be64e9558a4acab8ea53d79dc639e1, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.980117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.053574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1216/2448] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:52 2022] PUT /identity/v3/projects/4e25a2f6c3f442ef83739e47c7f59ded/users/e3be64e9558a4acab8ea53d79dc639e1/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:53.064485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.064838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.065151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.092232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] MFA Rules not processed for user `e3be64e9558a4acab8ea53d79dc639e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:53.093449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:53.158427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1233/2449] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:53.163000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.223998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f302-a7cf-4c0f-98e4-56558a7ab100 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.229265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.229922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.230202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.230473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.231165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.233092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.350195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1217/2450] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/projects => generated 409 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:53.355341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.365951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf6bb7-ac20-4f97-9208-6e32d647c147 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.422299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.422978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.423268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.423551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.424252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.426227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.533840 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1234/2451] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:07:53.537788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.548312 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4b54-39a0-44e6-95a1-b33fa1cc6fb7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.552962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.553627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.553914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.554203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.555248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.556883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.567246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1218/2452] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:53.571862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.581818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d00a-7ea7-42ac-a6cf-cba24f3ecaa8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.587023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.587927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.588216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.588500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] PATH_INFO: `/v3/projects/39c9e43ccc5e4f668737906a7b8419a6/users/680655a2c6a84ce49cb3d4213f735e81/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.600424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:53.603434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c9e43ccc5e4f668737906a7b8419a6, user_id=680655a2c6a84ce49cb3d4213f735e81, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.606188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.767511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1235/2453] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:53 2022] PUT /identity/v3/projects/39c9e43ccc5e4f668737906a7b8419a6/users/680655a2c6a84ce49cb3d4213f735e81/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:07:53.771454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.782183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bcdf-253c-468f-96f8-65743669ced7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.826497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:53.837699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.838364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.838646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.841195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.841195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.841382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9587653-fa7a-4128-b88d-2188a8338fe9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.850815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1219/2454] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:53.854901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.865068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b615-8222-48ea-9cd3-e0c216b0c642 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.870924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.871803 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.872090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.872369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] PATH_INFO: `/v3/projects/39c9e43ccc5e4f668737906a7b8419a6/users/680655a2c6a84ce49cb3d4213f735e81/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.874360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c9e43ccc5e4f668737906a7b8419a6, user_id=680655a2c6a84ce49cb3d4213f735e81, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.877086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.887740 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1236/2455] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:53 2022] PUT /identity/v3/projects/39c9e43ccc5e4f668737906a7b8419a6/users/680655a2c6a84ce49cb3d4213f735e81/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:07:53.902826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.903122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.903403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.930213 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] MFA Rules not processed for user `680655a2c6a84ce49cb3d4213f735e81`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:53.931434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:53.998735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1220/2456] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:54.011609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:54.013612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:54.076727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f69ed-571f-4f08-a6ae-c7c6fc3610c3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:54.080427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:54.081127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:54.081413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:54.081688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:54.091169 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:54.092647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:54.102665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1237/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:07:54.531609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:54.541853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7c78d-af62-45e1-953e-2248e4a85652 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:54.545452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:54.546097 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:54.546387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:54.546668 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:54.614265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:54.615701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:54.625066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1221/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:02.732570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.734052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.793094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab632-eb0a-4f1d-8da2-d89b594a2995 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.796733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.797368 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.797674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.797953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.799745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.863357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.864723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9a9b5-2f4a-4c51-9ec8-bf441fbe2336 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.875371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1238/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:02.948226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.959510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5108b-15ee-4abc-91ca-dd4da9e4ef6a service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.964378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.965326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.965604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.965885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] PATH_INFO: `/v3/users/e3be64e9558a4acab8ea53d79dc639e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.967158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3be64e9558a4acab8ea53d79dc639e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.969182 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:03.245857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3be64e9558a4acab8ea53d79dc639e1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.246543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3be64e9558a4acab8ea53d79dc639e1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.247367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3be64e9558a4acab8ea53d79dc639e1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.258659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3be64e9558a4acab8ea53d79dc639e1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.400806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3be64e9558a4acab8ea53d79dc639e1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.402135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:03.420554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1222/2460] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:02 2022] DELETE /identity/v3/users/e3be64e9558a4acab8ea53d79dc639e1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:03.425060 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:03.425428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:03.425784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:03.460968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:03.464386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:03.495457 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:03.535099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1239/2461] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:03.546835 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:03.548747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:03.611300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d972b7-7431-4e8b-8f08-c05b2f516e0d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:03.618451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:03.619157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:03.619690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:03.619981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:03.629659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:03.631101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:03.641746 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1223/2462] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:04.121188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:04.123236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:04.156214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448b74-c227-4e47-a0c5-0d2b767036f2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:04.168911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:04.168911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:04.168911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:04.168911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] PATH_INFO: `/v3/projects/4e25a2f6c3f442ef83739e47c7f59ded` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:04.169729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e25a2f6c3f442ef83739e47c7f59ded)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:04.170638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:04.312884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e25a2f6c3f442ef83739e47c7f59ded', 'request_id': 'req-70e32a75-deee-4176-976b-2c9e60ca0d33'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.464651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e25a2f6c3f442ef83739e47c7f59ded', 'request_id': 'req-70e32a75-deee-4176-976b-2c9e60ca0d33'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.472057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e25a2f6c3f442ef83739e47c7f59ded', 'request_id': 'req-70e32a75-deee-4176-976b-2c9e60ca0d33'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.485549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] The token cache is being invalidate because project 4e25a2f6c3f442ef83739e47c7f59ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:04.485834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.486485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.488074 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1240/2463] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:04 2022] DELETE /identity/v3/projects/4e25a2f6c3f442ef83739e47c7f59ded => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:04.492564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:04.502999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e301c-19a4-41a7-bee3-4a76b12c13d0 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:04.584567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:04.585814 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:04.586264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:04.586858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] PATH_INFO: `/v3/users/680655a2c6a84ce49cb3d4213f735e81` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:04.588498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680655a2c6a84ce49cb3d4213f735e81)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:04.592207 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:04.966354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680655a2c6a84ce49cb3d4213f735e81'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.967269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680655a2c6a84ce49cb3d4213f735e81'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.968030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680655a2c6a84ce49cb3d4213f735e81'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.977748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680655a2c6a84ce49cb3d4213f735e81'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.048474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-356ca464-645b-4a86-8d43-8b35728a41a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680655a2c6a84ce49cb3d4213f735e81'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.072053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1224/2464] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:04 2022] DELETE /identity/v3/users/680655a2c6a84ce49cb3d4213f735e81 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:05.753695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.755204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:05.770678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e32a75-deee-4176-976b-2c9e60ca0d33 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.845220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.852848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.852848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.852848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] PATH_INFO: `/v3/projects/39c9e43ccc5e4f668737906a7b8419a6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.852848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c9e43ccc5e4f668737906a7b8419a6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.852848 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.029622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c9e43ccc5e4f668737906a7b8419a6', 'request_id': 'req-8bf1a261-7c9f-498f-bbbf-c36050198c7c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:06.097635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c9e43ccc5e4f668737906a7b8419a6', 'request_id': 'req-8bf1a261-7c9f-498f-bbbf-c36050198c7c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:06.099057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:06.108153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c9e43ccc5e4f668737906a7b8419a6', 'request_id': 'req-8bf1a261-7c9f-498f-bbbf-c36050198c7c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:06.118577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] The token cache is being invalidate because project 39c9e43ccc5e4f668737906a7b8419a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:06.118741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:06.119290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8bf1a261-7c9f-498f-bbbf-c36050198c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:06.121584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1241/2465] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:05 2022] DELETE /identity/v3/projects/39c9e43ccc5e4f668737906a7b8419a6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:06.126433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.126900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.127126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.134679 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:06.149486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:06.150732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.241266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1225/2466] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:06.245662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.245880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.246037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.280342 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:06.281529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.290584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1242/2467] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:06.295017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.306893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190b43-1c57-4dd5-bc29-a55b69bc8641 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.313769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.314620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.314875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.315149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.315888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:06.316195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.317857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.330543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1226/2468] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:06.334789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.344786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1768-f2ff-4eae-948a-a8966e15f6e3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.350162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.350873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.351711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.351986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.352807 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.354751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.488651 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1243/2469] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:06.493726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.504174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848406-8cff-44e3-8f82-006864fbfe60 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.571009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.572014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.572370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.572707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.573436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.575611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.719320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1227/2470] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:06.723438 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.744446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efac57-b17d-4f30-8b08-1e6946e36c14 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.750350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.751118 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.751485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.751845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.752685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.754421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.766999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1244/2471] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:06.770939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.781775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0548f6-7224-4cb1-bf77-4c888dd9bd1a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.786675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.787367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.787629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.787910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.788906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.790865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.806201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1228/2472] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:06.806357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.816306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a439a6-2d20-439a-857d-1498b2f0f22a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.822110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.823039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.823437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.823725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] PATH_INFO: `/v3/projects/80bc2ee55ec849e3ba76b3c997306ae3/users/8d47a8c39b6248f5b7919bdc74c3cdf0/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.840227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bc2ee55ec849e3ba76b3c997306ae3, user_id=8d47a8c39b6248f5b7919bdc74c3cdf0, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.843021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9252f66-9436-45ef-9ff8-a870efc112f3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.865831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.868454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.882347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb61ac-ab1f-4258-af59-56a414960b8c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.888336 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.889252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.889543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.889826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] PATH_INFO: `/v3/users/b75999cf46b744d2b5623c5615db2401` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.891039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75999cf46b744d2b5623c5615db2401)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.893074 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.916983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1245/2473] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:06 2022] PUT /identity/v3/projects/80bc2ee55ec849e3ba76b3c997306ae3/users/8d47a8c39b6248f5b7919bdc74c3cdf0/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:06.927261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.933324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.933324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.953735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] MFA Rules not processed for user `8d47a8c39b6248f5b7919bdc74c3cdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:06.954943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.022084 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1246/2474] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:07.026643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.083711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75999cf46b744d2b5623c5615db2401'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.084320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75999cf46b744d2b5623c5615db2401'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.084979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75999cf46b744d2b5623c5615db2401'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.089657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844bbf-f33b-423e-bae7-9c5c0e2f1399 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.091875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75999cf46b744d2b5623c5615db2401'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.094319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.095063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.095604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.095753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.096445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.098434 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.112799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:07.183526 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75999cf46b744d2b5623c5615db2401'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.184898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:07.202476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1229/2475] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:06 2022] DELETE /identity/v3/users/b75999cf46b744d2b5623c5615db2401 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:07.221972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1247/2476] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:07.225827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.227795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.294896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66d3c-71f5-493e-9d5f-48b129fbd030 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.352392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.353079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.353369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.353645 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.354359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.356486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.483447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1230/2477] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:07.484055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.487361 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.487519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.497896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f04a-4366-493c-a181-a0cf837a0bd3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.499490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f8ee-5c17-4f17-8214-4bdc2ff90487 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.503389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.504552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.505289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.505427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.506261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.506409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.506709 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.507055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] PATH_INFO: `/v3/projects/1eecb630e16b46b7970cb58916ead32c` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.507651 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.508723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eecb630e16b46b7970cb58916ead32c)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.510134 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.510792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.522181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1231/2478] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:07.529816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.541810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2f7c-46ef-41d6-ac55-59266141fb74 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.546658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.547581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.547861 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.548136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] PATH_INFO: `/v3/projects/96cde35b25f64666858b1a168c1df3ab/users/3a5fcc7a48b44dc6998a862a1374fb9e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.568190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cde35b25f64666858b1a168c1df3ab, user_id=3a5fcc7a48b44dc6998a862a1374fb9e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.571087 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.693437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1232/2479] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:07 2022] PUT /identity/v3/projects/96cde35b25f64666858b1a168c1df3ab/users/3a5fcc7a48b44dc6998a862a1374fb9e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:07.697800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.702366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eecb630e16b46b7970cb58916ead32c', 'request_id': 'req-504e7d42-affb-4a15-abc9-8e06bb403940'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.742171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:07.759932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b8ee-4098-4ec9-a33c-90a185450a75 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.790454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eecb630e16b46b7970cb58916ead32c', 'request_id': 'req-504e7d42-affb-4a15-abc9-8e06bb403940'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.797987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eecb630e16b46b7970cb58916ead32c', 'request_id': 'req-504e7d42-affb-4a15-abc9-8e06bb403940'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.809344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] The token cache is being invalidate because project 1eecb630e16b46b7970cb58916ead32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:07.809730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.810333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-504e7d42-affb-4a15-abc9-8e06bb403940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:07.811964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1248/2480] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:07 2022] DELETE /identity/v3/projects/1eecb630e16b46b7970cb58916ead32c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:07.816451 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.816865 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa098bf-42db-467a-9d37-71bd357fc42d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.817158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.821556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa098bf-42db-467a-9d37-71bd357fc42d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.821556 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa098bf-42db-467a-9d37-71bd357fc42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.821764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.821764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.821764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.821764 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.834287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1233/2481] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:07.835261 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.836814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-dfa098bf-42db-467a-9d37-71bd357fc42d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:07.837772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.838013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dfa098bf-42db-467a-9d37-71bd357fc42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.845939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1249/2482] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:07.850051 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe1c91-92a1-4e6c-9833-ecc289b35303 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.855091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.856088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.856369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.856653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] PATH_INFO: `/v3/projects/96cde35b25f64666858b1a168c1df3ab/users/3a5fcc7a48b44dc6998a862a1374fb9e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.856890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.857280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.857566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.858706 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cde35b25f64666858b1a168c1df3ab, user_id=3a5fcc7a48b44dc6998a862a1374fb9e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.861404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9ec7-ee74-42dd-92a3-afd0113b169e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.873277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1234/2483] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:07 2022] PUT /identity/v3/projects/96cde35b25f64666858b1a168c1df3ab/users/3a5fcc7a48b44dc6998a862a1374fb9e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:07.876036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:07.879024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.890616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.891060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.891346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.919130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] MFA Rules not processed for user `3a5fcc7a48b44dc6998a862a1374fb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:07.920490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:07.940846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1250/2484] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:07.945836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.955347 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ae8c7-4e09-47d1-9aa5-a0d5cc856d25 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.959984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.961522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:07.961859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:07.962315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:07.963150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:07.963466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:07.965319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:07.983100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1251/2485] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:07.984064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:07.994113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173096-5740-4765-997d-d3ee53bdb48a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:07.997389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1235/2486] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:07.999112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:07.999770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.000098 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.000380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.001196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.003108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.009450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.010967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:08.071963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604dc8-fce5-42f9-afea-4b0a8807cf32 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.075656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.076290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.076573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.076884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.086010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.087436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.092371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:08.097044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1236/2487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:08.118291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1252/2488] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:07 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:08.122854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.134173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe753e8-9986-4518-bf04-5e5a0b539703 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.189772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.190445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.190729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.191005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.191698 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.193690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.322601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1237/2489] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:08 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:08.322699 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.336107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193089c-f26a-4015-b729-aeac96809f9a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.343792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.344462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.344782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.345064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.345797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.347471 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.365486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1253/2490] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:08.368838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.379946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2432d6-36e2-4cfa-9603-9fbc35aa49ee admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.385528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.386198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.386480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.386754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.387488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.389146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1ec16-06b6-4574-aca0-4a41f30dc308 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.400661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1238/2491] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:08.404607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.415393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823f1a-7018-4d04-8dac-a61796280a7b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.421046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.421983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.422268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.422544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] PATH_INFO: `/v3/projects/5d27c5cb510f40fb8cde08c14d8ab647/users/4e77a67930784a16b262b6ad0bbd17c1/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.441912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d27c5cb510f40fb8cde08c14d8ab647, user_id=4e77a67930784a16b262b6ad0bbd17c1, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.445261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.566442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1254/2492] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:08 2022] PUT /identity/v3/projects/5d27c5cb510f40fb8cde08c14d8ab647/users/4e77a67930784a16b262b6ad0bbd17c1/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:08.581034 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.581330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.581612 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.610817 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] MFA Rules not processed for user `4e77a67930784a16b262b6ad0bbd17c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:08.612016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:08.675816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1239/2493] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:08.680497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.685546 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:08.702735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.747652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6cd5-92bb-48dd-8d3d-7605f3d5f989 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.752567 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.753295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.753583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.753883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.754589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.756503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.766620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1eb82-981a-4649-b4aa-7e38ecbec621 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.771405 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.772293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.772577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.772892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] PATH_INFO: `/v3/users/8d47a8c39b6248f5b7919bdc74c3cdf0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.774735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d47a8c39b6248f5b7919bdc74c3cdf0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.776712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:08.787272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:08.872198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1255/2494] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:08 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:08.876122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:08.936771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60078963-1877-4e97-b174-9792f15ff6a2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:08.941397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:08.942068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:08.942355 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:08.942637 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:08.943353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:08.945905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.021389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d47a8c39b6248f5b7919bdc74c3cdf0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:09.021956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d47a8c39b6248f5b7919bdc74c3cdf0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:09.022554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d47a8c39b6248f5b7919bdc74c3cdf0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:09.029492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d47a8c39b6248f5b7919bdc74c3cdf0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:09.076878 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1256/2495] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:08 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:09.080735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.082333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:09.094004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe2a7-f718-4de1-a3da-a745cad39696 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.098703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.099343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.099630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.099909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.100656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.102477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.112126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1257/2496] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:09.118756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.128276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489f1-820a-4097-9a9e-dd59d06cd5eb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.133683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.134531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.134815 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.135093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] PATH_INFO: `/v3/projects/c49efe1f5183499caf8abc1d27a91b55/users/7f689995685a41d5b6e1a4d573241e6e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.139791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9ab86f59-eaa0-4f5e-b86e-c71d89c0c8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d47a8c39b6248f5b7919bdc74c3cdf0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:09.150259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49efe1f5183499caf8abc1d27a91b55, user_id=7f689995685a41d5b6e1a4d573241e6e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.152911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.157902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1240/2497] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:08 2022] DELETE /identity/v3/users/8d47a8c39b6248f5b7919bdc74c3cdf0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:09.162320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.162611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.162887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.180485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:09.181842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:09.231284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1258/2498] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:09 2022] PUT /identity/v3/projects/c49efe1f5183499caf8abc1d27a91b55/users/7f689995685a41d5b6e1a4d573241e6e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:09.235291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.239368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1241/2499] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:09.249851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.251190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:09.298825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439112e-0969-4ca1-b948-9fc2b69bde3f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.303631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.304996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.305320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.305585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.306298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.307912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.312779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64005a1-b071-41df-bfb0-f38c1d2e0220 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.316441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:09.324268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1259/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:09.325154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.335000 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5272-c74e-44db-a0f8-79b7aa16d1af admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.339839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.340767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.341056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.341333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] PATH_INFO: `/v3/projects/c49efe1f5183499caf8abc1d27a91b55/users/7f689995685a41d5b6e1a4d573241e6e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.343300 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49efe1f5183499caf8abc1d27a91b55, user_id=7f689995685a41d5b6e1a4d573241e6e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.346569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0073a-b9e9-4dc2-83e9-af997f01e761 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.357773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:09.359634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1260/2501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:09 2022] PUT /identity/v3/projects/c49efe1f5183499caf8abc1d27a91b55/users/7f689995685a41d5b6e1a4d573241e6e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:09.365841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.366506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.367594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.367918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.370390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.370739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.370964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.378494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.379949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.390758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1242/2502] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:09.400182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] MFA Rules not processed for user `7f689995685a41d5b6e1a4d573241e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:09.401912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:09.486052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1261/2503] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:09.507161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.508655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:09.565067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a6ee6-24da-4385-b985-7e422b4fb2a5 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:09.613450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:09.614102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:09.614386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:09.614662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:09.624890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:09.626353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:09.636504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1243/2504] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:09.920814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:09.922753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:10.011421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c490c4-28a2-4343-8983-d4b4674c96a3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:10.016830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:10.017719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:10.018004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:10.018277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] PATH_INFO: `/v3/projects/80bc2ee55ec849e3ba76b3c997306ae3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:10.019531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bc2ee55ec849e3ba76b3c997306ae3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:10.021501 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:10.139451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bc2ee55ec849e3ba76b3c997306ae3', 'request_id': 'req-25db42e2-5fc0-4538-ac5e-a452a923b66a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.141872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:10.197153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bc2ee55ec849e3ba76b3c997306ae3', 'request_id': 'req-25db42e2-5fc0-4538-ac5e-a452a923b66a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.204124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bc2ee55ec849e3ba76b3c997306ae3', 'request_id': 'req-25db42e2-5fc0-4538-ac5e-a452a923b66a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.215095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] The token cache is being invalidate because project 80bc2ee55ec849e3ba76b3c997306ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:10.215381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.216042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.217601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1262/2505] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:09 2022] DELETE /identity/v3/projects/80bc2ee55ec849e3ba76b3c997306ae3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:10.221565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:10.232148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91998-fb00-4f66-83aa-ba271b602025 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:10.296910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:10.297892 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:10.298183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:10.298504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] PATH_INFO: `/v3/users/3a5fcc7a48b44dc6998a862a1374fb9e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:10.299739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5fcc7a48b44dc6998a862a1374fb9e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:10.301726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:10.734369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5fcc7a48b44dc6998a862a1374fb9e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.735022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5fcc7a48b44dc6998a862a1374fb9e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.735628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5fcc7a48b44dc6998a862a1374fb9e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.736881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:10.743732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5fcc7a48b44dc6998a862a1374fb9e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.858696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bc3e467e-3f0e-4fbe-80b2-fedcde6b3ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5fcc7a48b44dc6998a862a1374fb9e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:10.877053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1244/2506] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:10 2022] DELETE /identity/v3/users/3a5fcc7a48b44dc6998a862a1374fb9e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:11.460941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:11.462419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:11.475611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db42e2-5fc0-4538-ac5e-a452a923b66a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:11.540310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:11.542553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:11.542553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:11.542553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] PATH_INFO: `/v3/projects/96cde35b25f64666858b1a168c1df3ab` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:11.543214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cde35b25f64666858b1a168c1df3ab)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:11.545217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:11.699766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cde35b25f64666858b1a168c1df3ab', 'request_id': 'req-7d513176-534d-4afd-85e0-19a2cabe8a08'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:11.818606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cde35b25f64666858b1a168c1df3ab', 'request_id': 'req-7d513176-534d-4afd-85e0-19a2cabe8a08'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:11.825869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cde35b25f64666858b1a168c1df3ab', 'request_id': 'req-7d513176-534d-4afd-85e0-19a2cabe8a08'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:11.837399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] The token cache is being invalidate because project 96cde35b25f64666858b1a168c1df3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:11.837684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:11.838329 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7d513176-534d-4afd-85e0-19a2cabe8a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:11.839905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1263/2507] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:11 2022] DELETE /identity/v3/projects/96cde35b25f64666858b1a168c1df3ab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:11.844806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:11.845308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:11.845411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:11.866205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:11.873110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:11.937881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1245/2508] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:11.946147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:11.946442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:11.946723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:11.966804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:11.968055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:11.976640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1264/2509] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:11.981090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:11.991151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70494ba-0170-4b5d-ab12-ee33dc721101 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:11.998858 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:11.999493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:11.999772 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.000047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.000828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:12.001132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.002742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.025653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.028873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1246/2510] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:12.040276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9e5f-e46a-4d22-8923-b1bb7f9bfef1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.042500 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.043285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.043644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.043921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.044715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.046550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.178262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1265/2511] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:12 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:12.179289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.189359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03a6a-9f4d-47d8-a602-e7520c043edd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.252930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.254888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.255253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.255690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.256483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.259121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.466694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1247/2512] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:12 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:12.474745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.493410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1e24a-7cdb-4927-8ff3-04c7606f2aad admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.498524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.499344 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.499687 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.500038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.500900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.507769 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.520557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1266/2513] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:12.524934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.537319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7685-de59-4042-b9c9-96dce3a22d97 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.543758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.544454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.544782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.545103 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.545847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.547737 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d6a53-ceb6-4784-a3c2-7166499f00e7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.560709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1248/2514] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:12.564512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.580274 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b34718-c3da-473b-8c22-19042db2204d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.585164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.586069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.586468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.586622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] PATH_INFO: `/v3/projects/cee73f2098f147d5b0e3d8ab70b3af3b/users/e037b06b612447659220a20b6bd2e32d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.602701 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee73f2098f147d5b0e3d8ab70b3af3b, user_id=e037b06b612447659220a20b6bd2e32d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.605592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.683446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1267/2515] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:12 2022] PUT /identity/v3/projects/cee73f2098f147d5b0e3d8ab70b3af3b/users/e037b06b612447659220a20b6bd2e32d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:12.695850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.696391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.696752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.727603 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] MFA Rules not processed for user `e037b06b612447659220a20b6bd2e32d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:12.728944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:12.750493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:12.825516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1249/2516] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:12.839018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.840977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:12.852859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:12.910416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078daac-fd01-49ef-8ff5-e678145865ec admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.927376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.929117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.929606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.930061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.941351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.942924 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec918259-5203-4916-98e4-f541b21b7c34 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.957508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1268/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:12.983874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:13.062442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962bdd-805a-4489-8caa-67bae76ee8a5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:13.069257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:13.071294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.071781 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.072062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] PATH_INFO: `/v3/users/e037b06b612447659220a20b6bd2e32d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.073506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e037b06b612447659220a20b6bd2e32d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:13.075972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:13.291374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e037b06b612447659220a20b6bd2e32d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.292146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e037b06b612447659220a20b6bd2e32d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.292943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e037b06b612447659220a20b6bd2e32d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.300251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e037b06b612447659220a20b6bd2e32d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.474851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e037b06b612447659220a20b6bd2e32d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.499665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1250/2518] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:12 2022] DELETE /identity/v3/users/e037b06b612447659220a20b6bd2e32d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:13.504463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.505391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.506421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.525236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:13.526543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:13.586444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1269/2519] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:13.599741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:13.601228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:13.658967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:13.679644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0daa3b-1e4d-47f6-9324-91c1b3b69328 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:13.684800 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:13.685580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.686142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.686552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.707108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:13.707108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865438-f8b2-4c94-94dc-0d4dc8910f25 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:13.720690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1251/2520] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:13.783968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:13.785429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:13.798769 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8615c5-29d9-4091-9084-d60c9df6dae7 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:13.811387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:13.812585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.813103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.813588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] PATH_INFO: `/v3/users/4e77a67930784a16b262b6ad0bbd17c1` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.815063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e77a67930784a16b262b6ad0bbd17c1)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:13.817450 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.051600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e77a67930784a16b262b6ad0bbd17c1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.059390 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e77a67930784a16b262b6ad0bbd17c1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.060113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e77a67930784a16b262b6ad0bbd17c1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.060758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e77a67930784a16b262b6ad0bbd17c1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.161789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e77a67930784a16b262b6ad0bbd17c1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.182774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1270/2521] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:13 2022] DELETE /identity/v3/users/4e77a67930784a16b262b6ad0bbd17c1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:14.187335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.187834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.187931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.207040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:14.207040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.265022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1252/2522] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:14.275727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.277182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.285966 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.287687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.301441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518114a-266f-4b04-bb0a-504567eaf1d6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.306558 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.307434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.307896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.308360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] PATH_INFO: `/v3/projects/cee73f2098f147d5b0e3d8ab70b3af3b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.309785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee73f2098f147d5b0e3d8ab70b3af3b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.312552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.312972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:14.346077 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdd447-f4ac-41f8-b0d8-bb171de3bce1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.349659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.350311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.350596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.351536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.361115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.363242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74448-ae1b-4fe4-bf50-d35e2a7bdced service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.372626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1271/2523] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:14.466120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee73f2098f147d5b0e3d8ab70b3af3b', 'request_id': 'req-67c41daa-003b-4d92-bc51-c9392187e5fc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.561350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee73f2098f147d5b0e3d8ab70b3af3b', 'request_id': 'req-67c41daa-003b-4d92-bc51-c9392187e5fc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.567992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee73f2098f147d5b0e3d8ab70b3af3b', 'request_id': 'req-67c41daa-003b-4d92-bc51-c9392187e5fc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.580039 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] The token cache is being invalidate because project cee73f2098f147d5b0e3d8ab70b3af3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:14.580395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.581180 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-67c41daa-003b-4d92-bc51-c9392187e5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.587337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1253/2524] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:14 2022] DELETE /identity/v3/projects/cee73f2098f147d5b0e3d8ab70b3af3b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:14.589044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.595267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.595267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.608187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:14.609433 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.673752 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1272/2525] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:14.738343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.738638 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.738917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.758053 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:14.759471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.767292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1254/2526] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:14.771587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.782145 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6d7f-9cf7-4057-94b6-9350798a93ec None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.786829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.787489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.787779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.788062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.789021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:14.789336 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.791054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.802853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1273/2527] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:14.808013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.815517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.817501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94a02-d71c-4e2f-b220-f10ec828fa82 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.819044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.822963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.823826 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.824113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.824391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.825173 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.827198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.853427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c236c5-9e98-4ff8-b4f3-a19bb82f9321 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.858132 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.858998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.859282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.859557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] PATH_INFO: `/v3/projects/5d27c5cb510f40fb8cde08c14d8ab647` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.862031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d27c5cb510f40fb8cde08c14d8ab647)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.863944 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.923485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1255/2528] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:14.927478 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.967906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:14.987725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a36fd-aa2f-4528-9afe-917d479976bd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.000118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.000118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.000118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.000118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.000719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.000719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.010823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d27c5cb510f40fb8cde08c14d8ab647', 'request_id': 'req-1fc583d7-60da-4ec5-8a6c-573478e5ea25'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.125320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d27c5cb510f40fb8cde08c14d8ab647', 'request_id': 'req-1fc583d7-60da-4ec5-8a6c-573478e5ea25'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.130629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1256/2529] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:15.133852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d27c5cb510f40fb8cde08c14d8ab647', 'request_id': 'req-1fc583d7-60da-4ec5-8a6c-573478e5ea25'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.134032 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.143557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179d55-82cf-4331-a57b-f9635ee61496 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.144810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] The token cache is being invalidate because project 5d27c5cb510f40fb8cde08c14d8ab647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:15.145107 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.145765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.147337 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1274/2530] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:14 2022] DELETE /identity/v3/projects/5d27c5cb510f40fb8cde08c14d8ab647 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:15.151406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.152720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.194291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:15.201788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.202469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.202755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.203031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.203793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.205430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.215823 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1257/2531] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:15.225140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc583d7-60da-4ec5-8a6c-573478e5ea25 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.225264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.225264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.226910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.228558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.228968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.229340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] PATH_INFO: `/v3/users/7f689995685a41d5b6e1a4d573241e6e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.230691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f689995685a41d5b6e1a4d573241e6e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.233397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.250317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa0d50-c807-41d4-8613-00a3e5337107 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.261148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.261805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.262099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.262506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.263166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.264836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.275512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1258/2532] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:15.279609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.290441 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1552c-4cb6-40c3-899d-e80e31244c82 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.295070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.295950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.296263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.296535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] PATH_INFO: `/v3/projects/a133317a1ff843c5aea44c8b7dc5c4cf/users/ba938cfccf7241f4b8ef46603e5e4d35/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.313347 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a133317a1ff843c5aea44c8b7dc5c4cf, user_id=ba938cfccf7241f4b8ef46603e5e4d35, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.316130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1793-57b9-41f5-a531-85fc75b489a0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.390907 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1259/2533] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:15 2022] PUT /identity/v3/projects/a133317a1ff843c5aea44c8b7dc5c4cf/users/ba938cfccf7241f4b8ef46603e5e4d35/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:15.401075 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.401383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.401667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.428654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f689995685a41d5b6e1a4d573241e6e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.429948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] MFA Rules not processed for user `ba938cfccf7241f4b8ef46603e5e4d35`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:15.431191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.437914 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f689995685a41d5b6e1a4d573241e6e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.438830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f689995685a41d5b6e1a4d573241e6e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.439562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f689995685a41d5b6e1a4d573241e6e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.499086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1260/2534] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:15.510940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.512560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.514643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f689995685a41d5b6e1a4d573241e6e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:15.536410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1275/2535] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:15 2022] DELETE /identity/v3/users/7f689995685a41d5b6e1a4d573241e6e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:15.581212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ce583-196b-4bf9-b8fd-03036fbd4ec3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.628988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.629641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.629927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.630202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.689788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.691353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bb75-aea7-44ae-96e6-76175f12dfae service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.702684 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1261/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:15.705794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:16.161673 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:16.164399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:16.231775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cf7f-61a4-4ea5-aa5f-3865e1fe6749 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:16.239402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:16.240288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.242165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.242165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] PATH_INFO: `/v3/projects/c49efe1f5183499caf8abc1d27a91b55` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.242482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49efe1f5183499caf8abc1d27a91b55)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:16.244406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:16.407957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49efe1f5183499caf8abc1d27a91b55', 'request_id': 'req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:16.522113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49efe1f5183499caf8abc1d27a91b55', 'request_id': 'req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:16.523565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:16.529879 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49efe1f5183499caf8abc1d27a91b55', 'request_id': 'req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:16.541325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] The token cache is being invalidate because project c49efe1f5183499caf8abc1d27a91b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:16.541576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:16.542425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-668ebcfb-37a5-4b36-bcf1-54abd2f84da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:16.544250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1276/2537] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:16 2022] DELETE /identity/v3/projects/c49efe1f5183499caf8abc1d27a91b55 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:16.555699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.556079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.556254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.575953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:16.577240 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:16.653225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1262/2538] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:16.662011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.662312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.662590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.682266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:16.683568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:16.692552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1277/2539] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:16.696970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:16.706718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb292578-fab1-4a84-8f97-79780fa5141c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:16.711728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:16.712406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.712707 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.713006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.713742 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:16.714052 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:16.715717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:16.728625 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1263/2540] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:16.732998 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:16.743466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c031b-7ed2-491b-a169-d5576d06721e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:16.748825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:16.749497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.749787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.750068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.750772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:16.752727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:16.866121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1278/2541] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:16 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:16.870997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:16.880914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f96d5-7024-41cf-ac97-5abe0596e74e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:16.892301 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:16.937005 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:16.937647 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:16.937956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:16.938231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:16.938936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:16.941022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.047987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1264/2542] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:16 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:17.052006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.063219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8e2d-a5d7-46ad-861e-91f4d573abd2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.067863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.068522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.068854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.069139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.069912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.071542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.081823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1279/2543] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:17.086548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.096563 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c745-d595-4484-8a7e-7f32df411022 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.101870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.102615 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.102943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.103252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.103983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.105631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad491cc-ccfb-4361-bab5-14c8059f3852 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.115515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1265/2544] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:17.120548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.130444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b6f6-d176-4c5a-8e34-02af48addd2f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.135033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.135909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.136191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.136466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] PATH_INFO: `/v3/projects/6c21f1c594934658a49e39775c18d8b9/users/d8622c605117406e951839878816113d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.151020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c21f1c594934658a49e39775c18d8b9, user_id=d8622c605117406e951839878816113d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.153698 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.223082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1280/2545] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:17 2022] PUT /identity/v3/projects/6c21f1c594934658a49e39775c18d8b9/users/d8622c605117406e951839878816113d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:17.234139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.234436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.234743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.261350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] MFA Rules not processed for user `d8622c605117406e951839878816113d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:17.262574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:17.330169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1266/2546] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:17.334799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.404605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a687f-dccf-4384-b38c-8b7181689811 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.409765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.410518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.415778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.415778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.415778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.415778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.552007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1281/2547] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:17 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:17.556104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.566873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1579c-bf23-4c5d-862b-49919b076fa6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.626050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.626730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.627016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.627290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.628085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.629969 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.750227 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1267/2548] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:17 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:17.750612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.756612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf83fc-4887-4ad1-b814-8ab86b6600f6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.761744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.762522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.762874 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.763219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.764019 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.765652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.777262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1282/2549] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:17.781547 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.792518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f36cc-bbd6-419b-aee3-8dee1ea7a397 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.797168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.799919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.799919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.799919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] PATH_INFO: `/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2/users/8938cbe8e4384315a452eafdc9641dcc/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.812110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:17.816080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd6ae5765d64eb3b92b099c2c2e55b2, user_id=8938cbe8e4384315a452eafdc9641dcc, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.818910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.966748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1268/2550] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:17 2022] PUT /identity/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2/users/8938cbe8e4384315a452eafdc9641dcc/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:17.970706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.980686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e533-76ba-40c0-829f-b1742e3161dc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.039596 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:18.049375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.049375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.049375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.049375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.053605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.053605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6c691-8a0f-46a7-91d8-bdc0c5ec580d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.061828 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1283/2551] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:18.065893 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:18.077386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c226a-b84a-4dc3-9799-d84ac14c79e0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.083016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.083909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.084194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.084512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] PATH_INFO: `/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2/users/8938cbe8e4384315a452eafdc9641dcc/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.087374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd6ae5765d64eb3b92b099c2c2e55b2, user_id=8938cbe8e4384315a452eafdc9641dcc, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.090050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.100610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1269/2552] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:18 2022] PUT /identity/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2/users/8938cbe8e4384315a452eafdc9641dcc/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:18.110746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.111624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.111624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.139297 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] MFA Rules not processed for user `8938cbe8e4384315a452eafdc9641dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:18.140516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.208838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1284/2553] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:18.220118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:18.221871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.278017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab83c3-1b01-4a9d-a6f0-207beda20087 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.281820 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.282468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.282758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.283044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.297106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.297106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14226-078e-4251-af20-86c8a4c4c5a7 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.306176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1270/2554] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:18.333953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:18.400559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6ba72-a52a-4774-9388-3cc550aaf299 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.405178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.406061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.406339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.406613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] PATH_INFO: `/v3/users/d8622c605117406e951839878816113d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.407816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8622c605117406e951839878816113d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.410099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.665326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8622c605117406e951839878816113d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:18.672115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8622c605117406e951839878816113d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:18.672882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8622c605117406e951839878816113d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:18.673497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8622c605117406e951839878816113d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:18.744288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8622c605117406e951839878816113d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:18.756486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:18.764258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1285/2555] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:18 2022] DELETE /identity/v3/users/d8622c605117406e951839878816113d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:18.768793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.769278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.769431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.789055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:18.790967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.858903 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:18.860461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.866568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1271/2556] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:18.884452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:18.885824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.918825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d4d3d-56fa-46fe-a8a3-db017d627302 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.922671 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.923326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.923614 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.923894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.925735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:18.938444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.939890 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.942839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe6ae-96b6-49f6-958f-d8d9ea2b1c42 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:18.946958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:18.947600 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:18.947881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:18.948157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:18.950668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1286/2557] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:18.957454 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:18.958890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:18.968876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1272/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:20.078121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:20.079869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:20.099051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c466a2-50aa-4ed5-80d2-1bd7dbc35712 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:20.105174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:20.111638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:20.111638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:20.111638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] PATH_INFO: `/v3/projects/6c21f1c594934658a49e39775c18d8b9` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:20.111638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c21f1c594934658a49e39775c18d8b9)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:20.111638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:20.258829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c21f1c594934658a49e39775c18d8b9', 'request_id': 'req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.402170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c21f1c594934658a49e39775c18d8b9', 'request_id': 'req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.409413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c21f1c594934658a49e39775c18d8b9', 'request_id': 'req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.424237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] The token cache is being invalidate because project 6c21f1c594934658a49e39775c18d8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:20.424370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.427657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.432561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1287/2559] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:20 2022] DELETE /identity/v3/projects/6c21f1c594934658a49e39775c18d8b9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:20.433998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:20.444749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c8cf-4952-4685-9699-c7828bdd2593 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:20.469214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:20.513172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:20.514083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:20.514486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:20.514818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] PATH_INFO: `/v3/users/8938cbe8e4384315a452eafdc9641dcc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:20.516037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8938cbe8e4384315a452eafdc9641dcc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:20.518003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:20.830149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8938cbe8e4384315a452eafdc9641dcc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.830869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8938cbe8e4384315a452eafdc9641dcc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.831482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8938cbe8e4384315a452eafdc9641dcc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.839370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8938cbe8e4384315a452eafdc9641dcc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.938676 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-484f5e74-a5c9-4a68-b3e8-18ab65bd47ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8938cbe8e4384315a452eafdc9641dcc'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:20.962204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1273/2560] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:20 2022] DELETE /identity/v3/users/8938cbe8e4384315a452eafdc9641dcc => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:21.534577 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:21.536154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:21.552069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbb76a-0b79-4158-89ea-dee3d5ad47cd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:21.621230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:21.622150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:21.622440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:21.622758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] PATH_INFO: `/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:21.624020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd6ae5765d64eb3b92b099c2c2e55b2)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:21.626072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:21.651904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:21.797206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd6ae5765d64eb3b92b099c2c2e55b2', 'request_id': 'req-b45776b2-322b-4566-abc0-6782440381b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.928392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd6ae5765d64eb3b92b099c2c2e55b2', 'request_id': 'req-b45776b2-322b-4566-abc0-6782440381b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.938883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd6ae5765d64eb3b92b099c2c2e55b2', 'request_id': 'req-b45776b2-322b-4566-abc0-6782440381b6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.951569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] The token cache is being invalidate because project cbd6ae5765d64eb3b92b099c2c2e55b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:21.951858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.952562 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-b45776b2-322b-4566-abc0-6782440381b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.954155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1288/2561] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:21 2022] DELETE /identity/v3/projects/cbd6ae5765d64eb3b92b099c2c2e55b2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:21.958916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:21.959387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:21.959593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:21.978363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:21.979578 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:22.052527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1274/2562] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:22.061219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.061543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.062086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.083499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:22.084755 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:22.094219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1289/2563] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:22.098370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.109876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95d5b-97f4-473b-8b19-cb3d5c0850a5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.115429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.116489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.116489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.116867 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.117424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:22.118402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.120369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.133348 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1275/2564] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:22.137789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.148363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99757a14-24f2-4198-a4c6-943ba261192d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.154467 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.155277 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.155656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.158190 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.158919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.165285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.287646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1290/2565] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:22.291310 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.308535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb83a5-51a0-4f96-99d8-f478bb73190c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.359047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:22.397873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.399340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.408324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.408324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.408324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.408324 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.530941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1276/2566] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:22.532211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.553218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad413bd-6b17-42dc-a7d9-5e9d3e993a69 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.567380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.568334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.568622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.568972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.569725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.573761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.588816 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1291/2567] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:22.592449 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.608921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77167-b08a-4f42-88aa-ab7abe000038 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.616026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.625221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.625221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.625221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.625221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.625221 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91c6cd-5452-46fc-9869-39da1f8f67ee admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.638245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1277/2568] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:22.642382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.657259 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0a49b-067d-4165-bee0-a98f66d66a52 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.667052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.668146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.668580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.668996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] PATH_INFO: `/v3/projects/72c834e5b7d2400fb21f89f0a3ef098d/users/596c6d65a10d473589a48e2d448c21a8/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.687990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c834e5b7d2400fb21f89f0a3ef098d, user_id=596c6d65a10d473589a48e2d448c21a8, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.691112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.800173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1292/2569] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:22 2022] PUT /identity/v3/projects/72c834e5b7d2400fb21f89f0a3ef098d/users/596c6d65a10d473589a48e2d448c21a8/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:22.810939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.811239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.811521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.864942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] MFA Rules not processed for user `596c6d65a10d473589a48e2d448c21a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:22.867108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:22.974697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1278/2570] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:22.980044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.058533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e4ffc-61d0-499b-a34c-f23d9df91013 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.061610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.062427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.062713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.062992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.063710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.065690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.169555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.171117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:23.185998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a1236-c1a0-4aa1-91ad-8815ffd2650c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.190697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.191574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.191859 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.192137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] PATH_INFO: `/v3/users/a426eed4598345878445c6ba2ab913d2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.193364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a426eed4598345878445c6ba2ab913d2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.195360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.210091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1293/2571] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:23.215125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.256996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:23.284949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b813-fcb4-4d9d-96d0-54f13c0affc3 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.290487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.291076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.291356 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.291631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.292315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.294265 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.529032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1294/2572] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:23.533919 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.544963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ad129-c305-4c44-afa0-1a0ff33b4459 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.549668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.550373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.550663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.550938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.551715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.553420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.569799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1295/2573] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:23.571900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.579680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a426eed4598345878445c6ba2ab913d2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:23.580528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a426eed4598345878445c6ba2ab913d2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:23.581295 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a426eed4598345878445c6ba2ab913d2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:23.583782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83918fc-e95b-4ca1-994e-cc75ee8aa232 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.589559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.590480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.590766 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.591044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] PATH_INFO: `/v3/projects/c65c8b362eb9427a92ce741dd287406e/users/5680919a23244244a5c86fe4068ad882/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.591536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a426eed4598345878445c6ba2ab913d2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:23.608376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65c8b362eb9427a92ce741dd287406e, user_id=5680919a23244244a5c86fe4068ad882, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.611177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.704482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a426eed4598345878445c6ba2ab913d2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:23.711062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1296/2574] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:23 2022] PUT /identity/v3/projects/c65c8b362eb9427a92ce741dd287406e/users/5680919a23244244a5c86fe4068ad882/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:23.715917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.719379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:23.730176 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1279/2575] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:23 2022] DELETE /identity/v3/users/a426eed4598345878445c6ba2ab913d2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:23.793408 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f8637-c6d5-4e50-8407-3efd9c10e03a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.860038 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.860435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.860742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.861022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.861756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.863389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032db1a9-1506-4ee3-8e3f-ae66491fc9e3 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.877303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1297/2576] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:23.881396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.893320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997546-fa51-4799-bf01-027c8cc6bdef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.898490 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.900342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.906164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.906164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] PATH_INFO: `/v3/projects/c65c8b362eb9427a92ce741dd287406e/users/5680919a23244244a5c86fe4068ad882/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.906164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65c8b362eb9427a92ce741dd287406e, user_id=5680919a23244244a5c86fe4068ad882, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.906164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.909908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:23.919794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1280/2577] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:23 2022] PUT /identity/v3/projects/c65c8b362eb9427a92ce741dd287406e/users/5680919a23244244a5c86fe4068ad882/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:23.934607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.935134 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.935543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.965720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] MFA Rules not processed for user `5680919a23244244a5c86fe4068ad882`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:23.966938 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:23.985988 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:24.043069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1298/2578] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:24.059364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.059861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.061854 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.062380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.145388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60238c-5c41-4d25-90fa-0eb57ca3e83a None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.153043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.153934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.154223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.154503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] PATH_INFO: `/v3/projects/1f1a6a82b6794f70b60c7e32d618e2ad` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.155279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17044fd-3354-467e-b42e-de30c151b1d1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.155712 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1a6a82b6794f70b60c7e32d618e2ad)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.157678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:24.159139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.160086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.160376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.160662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.171386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.172882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369690-7446-4d1a-a5cb-338ac0ee5917 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:24.183346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1281/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:24.308953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1a6a82b6794f70b60c7e32d618e2ad', 'request_id': 'req-4dd6a170-bb34-419d-8678-f85da2ad5bb6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:24.487238 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1a6a82b6794f70b60c7e32d618e2ad', 'request_id': 'req-4dd6a170-bb34-419d-8678-f85da2ad5bb6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:24.495006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1a6a82b6794f70b60c7e32d618e2ad', 'request_id': 'req-4dd6a170-bb34-419d-8678-f85da2ad5bb6'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:24.505445 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] The token cache is being invalidate because project 1f1a6a82b6794f70b60c7e32d618e2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:24.505757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:24.506406 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4dd6a170-bb34-419d-8678-f85da2ad5bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:24.508153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1299/2580] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:24 2022] DELETE /identity/v3/projects/1f1a6a82b6794f70b60c7e32d618e2ad => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:24.513770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c504-078b-4339-a013-49311f577f0e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.514179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c504-078b-4339-a013-49311f577f0e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.514461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c504-078b-4339-a013-49311f577f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.532433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-82c3c504-078b-4339-a013-49311f577f0e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:24.533991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-82c3c504-078b-4339-a013-49311f577f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.598167 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1282/2581] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:24.606113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.606620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.606728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.626175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:24.627681 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.638428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1300/2582] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:24.653425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c504-078b-4339-a013-49311f577f0e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.663343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c504-078b-4339-a013-49311f577f0e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.668976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.669643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.669931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.670210 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.670993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:24.671255 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.672925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:24.685325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1283/2583] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:24.689606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.699153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d69f9-a877-4d52-b67f-aeff0b28d2ce None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.707653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.708633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.709040 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.709309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.710041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.712453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:24.809262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1301/2584] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:24 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:24.813179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.823379 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d988-ef53-452a-9620-80337e69587f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.887933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.888530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.888846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.889131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.889819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.891730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.076247 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1284/2585] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:24 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:25.080375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.095282 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51a81-e593-4aa4-bf7a-649a8b9d9a9b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.103682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.104482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.108844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.108844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.108844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.108844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.123632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1302/2586] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:25.125355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.136920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957580-57bd-486f-aca4-c87e497c146d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.142260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.142883 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.143179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.143457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.144202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.145978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a215d-f637-4b2b-977b-ca07b3e5c0d3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.156805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1285/2587] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:25.161397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.173538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03303-fda2-43c3-82d4-f34e1c28b88e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.178293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.180768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.180768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.180768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] PATH_INFO: `/v3/projects/57947fa135254fb996f403d5733a2659/users/637e37c02a1f4c2cbfc443b4afcf1281/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.182886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:25.199638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57947fa135254fb996f403d5733a2659, user_id=637e37c02a1f4c2cbfc443b4afcf1281, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.202420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.323774 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1303/2588] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:25 2022] PUT /identity/v3/projects/57947fa135254fb996f403d5733a2659/users/637e37c02a1f4c2cbfc443b4afcf1281/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:25.342254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.342728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.343200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.353834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:25.377736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] MFA Rules not processed for user `637e37c02a1f4c2cbfc443b4afcf1281`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:25.379171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:25.402599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.402599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:25.452866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1286/2589] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:25.460501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.479534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755dff-dcb9-48c2-a7e3-730a43c5c370 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.489320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5680919a23244244a5c86fe4068ad882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65c8b362eb9427a92ce741dd287406e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.490193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.490486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.490782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.491541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:25.491860 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.493635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.507454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1304/2590] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:25.512332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.522738 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6915-279e-462d-8449-1d54812ec6b8 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.528151 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5680919a23244244a5c86fe4068ad882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65c8b362eb9427a92ce741dd287406e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.528908 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.529224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.529510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.530226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.532235 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.538553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941eddb-a587-4e6c-b045-9f869aa9a9d0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.545038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.545733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.545999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.546274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.546970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.549300 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.638787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1305/2591] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:25 2022] POST /identity/v3/projects => generated 354 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:25.644225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.701986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1287/2592] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:25 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:25.705819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.712215 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf99b9c-525d-4903-bf90-0a633fe7c297 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.773726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5680919a23244244a5c86fe4068ad882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65c8b362eb9427a92ce741dd287406e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.775045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.775338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.775620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.776372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:25.776719 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.777100 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb4e2a-10d5-454a-97d5-f8d316557836 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.778358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.781369 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:25.783763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.784461 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.784787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.785076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.785802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.787748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.792245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1306/2593] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:25.828230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.838796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac88d-9fd2-4200-8905-4389bab9df8f tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.843387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5680919a23244244a5c86fe4068ad882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65c8b362eb9427a92ce741dd287406e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.844243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.844529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.844835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] PATH_INFO: `/v3/projects/f3541cd082ad44d6b62d4c0fb7500453` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.846029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3541cd082ad44d6b62d4c0fb7500453)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.847916 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.882277 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1288/2594] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:25 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:25.886765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.896307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4153-21ec-4a8d-a3e0-d15eff8e7406 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.901930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.902611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.902905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.903183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.903901 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.906160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.908356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:25.917561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1289/2595] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:25.921695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.931326 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4debb-7674-4ba1-9da3-51d444faaf11 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.935981 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.936918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.937203 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.937483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] PATH_INFO: `/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b/users/d4c2369db3da495caf24a0c4c7a6a74b/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.952579 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b3544fdf2c40e28102db6f9ac84f5b, user_id=d4c2369db3da495caf24a0c4c7a6a74b, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.955282 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.957786 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3541cd082ad44d6b62d4c0fb7500453', 'request_id': 'req-2c64252f-53da-4e81-a41b-050a60f2d7c2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.060037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1290/2596] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:25 2022] PUT /identity/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b/users/d4c2369db3da495caf24a0c4c7a6a74b/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:26.063971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.070480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3541cd082ad44d6b62d4c0fb7500453', 'request_id': 'req-2c64252f-53da-4e81-a41b-050a60f2d7c2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.078465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3541cd082ad44d6b62d4c0fb7500453', 'request_id': 'req-2c64252f-53da-4e81-a41b-050a60f2d7c2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.089882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] The token cache is being invalidate because project f3541cd082ad44d6b62d4c0fb7500453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:26.090291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.090961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.092588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1307/2597] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:25 2022] DELETE /identity/v3/projects/f3541cd082ad44d6b62d4c0fb7500453 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:26.132040 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32857e-6b71-4c4b-bdb1-623b4d21b7fa admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.137662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.139258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.139258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.139258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.139682 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.141302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924eace-3526-4773-abe0-148182e45182 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.151517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1291/2598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:26.155849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.157291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.226201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64252f-53da-4e81-a41b-050a60f2d7c2 tempest-VolumeQuotaClassesTest-817487353 tempest-VolumeQuotaClassesTest-817487353-project-admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.231388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.232301 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.232605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.232922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] PATH_INFO: `/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b/users/d4c2369db3da495caf24a0c4c7a6a74b/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.236905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b3544fdf2c40e28102db6f9ac84f5b, user_id=d4c2369db3da495caf24a0c4c7a6a74b, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.237839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.249239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1308/2599] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:26 2022] PUT /identity/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b/users/d4c2369db3da495caf24a0c4c7a6a74b/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:26.259995 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.260500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.260818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.288932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] MFA Rules not processed for user `d4c2369db3da495caf24a0c4c7a6a74b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:26.290151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.360130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1292/2600] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:26.445155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.446997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.505025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056164a-0195-4284-976c-355921966ab1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.509348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.510001 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.510315 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.510615 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.519545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.520987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.530339 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1309/2601] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:26.825587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.835335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9f1b-dadb-46e7-81bc-31b81a8ef720 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.839556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.840196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.840484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.840796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.842596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.898397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:26.903320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.904798 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc5015-5a09-45f7-bc9a-2899ee0cc0ab service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.915060 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1293/2602] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:26.921351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.922862 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.942831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:26.989962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde390f4-8e31-491b-989a-388d0a1fe562 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.995305 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.996226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.996515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.996893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] PATH_INFO: `/v3/users/596c6d65a10d473589a48e2d448c21a8` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.998129 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=596c6d65a10d473589a48e2d448c21a8)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.000112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.289204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596c6d65a10d473589a48e2d448c21a8'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.295813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596c6d65a10d473589a48e2d448c21a8'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.296472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596c6d65a10d473589a48e2d448c21a8'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.297102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596c6d65a10d473589a48e2d448c21a8'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.395761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596c6d65a10d473589a48e2d448c21a8'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.414548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1310/2603] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:26 2022] DELETE /identity/v3/users/596c6d65a10d473589a48e2d448c21a8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:27.419320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.419843 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.419938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.436717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:27.438001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.497801 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1294/2604] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:27.507389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:27.509495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.565991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210eadb-0d1d-4c71-817e-edcbfcef424d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:27.569611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:27.570474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.571613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.571613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.580555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.582069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.595489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1311/2605] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:28.157397 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.158860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.171320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764d96-0c1c-4ee8-a1f0-f960c03ec03c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.175884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.176808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.177098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.177376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] PATH_INFO: `/v3/projects/72c834e5b7d2400fb21f89f0a3ef098d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.178594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c834e5b7d2400fb21f89f0a3ef098d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.181437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.344730 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c834e5b7d2400fb21f89f0a3ef098d', 'request_id': 'req-c92cb9de-565d-4013-8abb-23d6c2ab5df7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.526773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c834e5b7d2400fb21f89f0a3ef098d', 'request_id': 'req-c92cb9de-565d-4013-8abb-23d6c2ab5df7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.533404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c834e5b7d2400fb21f89f0a3ef098d', 'request_id': 'req-c92cb9de-565d-4013-8abb-23d6c2ab5df7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.544307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] The token cache is being invalidate because project 72c834e5b7d2400fb21f89f0a3ef098d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:28.544588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.545258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.546806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1295/2606] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:28 2022] DELETE /identity/v3/projects/72c834e5b7d2400fb21f89f0a3ef098d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:28.550757 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.560718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866a70f-eae1-4a48-b415-e8b27688ff2f service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.595958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:28.619120 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.620298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.620587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.621026 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] PATH_INFO: `/v3/users/5680919a23244244a5c86fe4068ad882` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.622224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5680919a23244244a5c86fe4068ad882)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.624143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.837374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5680919a23244244a5c86fe4068ad882'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.844639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5680919a23244244a5c86fe4068ad882'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.845326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5680919a23244244a5c86fe4068ad882'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.845923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5680919a23244244a5c86fe4068ad882'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.933105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5680919a23244244a5c86fe4068ad882'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.951393 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1312/2607] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:28 2022] DELETE /identity/v3/users/5680919a23244244a5c86fe4068ad882 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:29.128660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.130254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.143847 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb9de-565d-4013-8abb-23d6c2ab5df7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.218540 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.219430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.219715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.219994 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] PATH_INFO: `/v3/users/ba938cfccf7241f4b8ef46603e5e4d35` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.221238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba938cfccf7241f4b8ef46603e5e4d35)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.223194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.247288 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:29.403781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.405350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.420644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b4aea-3ac9-47d7-ab86-4201402c2563 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.425232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.426102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.426386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.427142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] PATH_INFO: `/v3/projects/c65c8b362eb9427a92ce741dd287406e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.435746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65c8b362eb9427a92ce741dd287406e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.435746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.567303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba938cfccf7241f4b8ef46603e5e4d35'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.567932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba938cfccf7241f4b8ef46603e5e4d35'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.568550 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba938cfccf7241f4b8ef46603e5e4d35'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.575793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba938cfccf7241f4b8ef46603e5e4d35'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.620887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65c8b362eb9427a92ce741dd287406e', 'request_id': 'req-88b9f152-4a89-4c68-944e-fcf10eaf946c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.668318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8797caf3-8663-4b8e-84db-34dcbfa64f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba938cfccf7241f4b8ef46603e5e4d35'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.687812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1296/2608] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:29 2022] DELETE /identity/v3/users/ba938cfccf7241f4b8ef46603e5e4d35 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:29.692364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.692711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.693010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.717222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:29.718470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.732909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65c8b362eb9427a92ce741dd287406e', 'request_id': 'req-88b9f152-4a89-4c68-944e-fcf10eaf946c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.739913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65c8b362eb9427a92ce741dd287406e', 'request_id': 'req-88b9f152-4a89-4c68-944e-fcf10eaf946c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.753741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] The token cache is being invalidate because project c65c8b362eb9427a92ce741dd287406e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:29.754036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.754749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-88b9f152-4a89-4c68-944e-fcf10eaf946c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:29.756611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1313/2609] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:29 2022] DELETE /identity/v3/projects/c65c8b362eb9427a92ce741dd287406e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:29.762110 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ac33-3681-43e8-956e-b9230b4c4869 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.762453 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ac33-3681-43e8-956e-b9230b4c4869 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.762623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ac33-3681-43e8-956e-b9230b4c4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.781379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9744ac33-3681-43e8-956e-b9230b4c4869 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:29.782594 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9744ac33-3681-43e8-956e-b9230b4c4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.786557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1297/2610] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:29.791222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1314/2611] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:29.794434 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.795829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.798636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.798991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.799383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.818636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:29.819917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.828831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1315/2612] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:29.832952 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.842362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e82c-5c96-4b2f-a918-2dc658dedcba None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.847454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.848168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.848461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.848781 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.849517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:29.849830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.851518 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.856462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bafd9b-43d8-4ff8-a537-b765d1cde485 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.860151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.860833 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.861117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.861391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.867121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1316/2613] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:29.868537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.873672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.874082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.879906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec434e-29ae-46b3-9609-9d856d494d26 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.885197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1298/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:29.886143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.886810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.887099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.887377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.888100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.890052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.902896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:30.043367 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1317/2615] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:30.047630 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.057794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495a11-e434-44ea-bd9f-47de7db9ffeb service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.097965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:30.117002 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.118333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.120376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.120376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.122841 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.124854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.222082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1299/2616] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:30.223775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.235811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf527-258c-4ca1-878e-e2198c2ffcd1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.240548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.241255 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.241541 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.241817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.243142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.245175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.255187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1318/2617] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:30.259120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.269351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeb880-5255-4c1b-9722-6158024cb7c4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.274271 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.274935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.275225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.275509 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.276275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.277925 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.287740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1300/2618] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:30.292242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.302363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700667f-7cf7-4a43-ae60-a9f0cef94d10 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.307882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.308791 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.309079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.309357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] PATH_INFO: `/v3/projects/1b749756ab974d758884c87e1b115ad3/users/8dbe3fa62715439185f01f8309e3dffa/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.323981 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b749756ab974d758884c87e1b115ad3, user_id=8dbe3fa62715439185f01f8309e3dffa, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.326659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed76b6-8a02-4848-b8c6-af71446b627f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.414864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.416779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.430724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689588bb-21b3-454d-b291-4fd0dbf468e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.435985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.436914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.437202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.437465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] PATH_INFO: `/v3/projects/a133317a1ff843c5aea44c8b7dc5c4cf` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.438690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a133317a1ff843c5aea44c8b7dc5c4cf)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.440743 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.493951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1319/2619] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:30 2022] PUT /identity/v3/projects/1b749756ab974d758884c87e1b115ad3/users/8dbe3fa62715439185f01f8309e3dffa/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:30.504448 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.504839 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.505126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.534164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] MFA Rules not processed for user `8dbe3fa62715439185f01f8309e3dffa`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:30.535375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.597865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a133317a1ff843c5aea44c8b7dc5c4cf', 'request_id': 'req-9aec89c1-23ce-4693-8783-2355911f3111'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:30.599014 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1320/2620] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:30.606836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.668105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dbd-9d3d-4c64-acdd-4718091d7d31 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.722490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.723113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.723389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.723661 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.724349 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.726326 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.729446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a133317a1ff843c5aea44c8b7dc5c4cf', 'request_id': 'req-9aec89c1-23ce-4693-8783-2355911f3111'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:30.742528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a133317a1ff843c5aea44c8b7dc5c4cf', 'request_id': 'req-9aec89c1-23ce-4693-8783-2355911f3111'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:30.750692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] The token cache is being invalidate because project a133317a1ff843c5aea44c8b7dc5c4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:30.750987 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:30.751701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9aec89c1-23ce-4693-8783-2355911f3111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:30.753511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1301/2621] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:30 2022] DELETE /identity/v3/projects/a133317a1ff843c5aea44c8b7dc5c4cf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:30.759244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5110f-2c94-47f0-94a9-7bee72a74bf3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.759538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5110f-2c94-47f0-94a9-7bee72a74bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.760171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5110f-2c94-47f0-94a9-7bee72a74bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.761885 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:30.780014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-93e5110f-2c94-47f0-94a9-7bee72a74bf3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:30.780014 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-93e5110f-2c94-47f0-94a9-7bee72a74bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.787874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1302/2622] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:30.797320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.797448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.797716 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.816530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:30.817864 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.826729 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1303/2623] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:30.830732 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.840617 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1321/2624] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/projects => generated 389 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:30.840837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0687b3d-30b8-4185-a11e-c74076dd44c7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.841749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.843376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.900111 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.900829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.901152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.901427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.902158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:30.902465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.904056 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.909852 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb054756-13f4-4bcb-a6a6-148a48bb4d25 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.914789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.915468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.915775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.916053 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.916784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.918516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1304/2625] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:30.928974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.931938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.941720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5d81-8f62-4140-8ed7-1a559d307033 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.947001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.947655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.947942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.948224 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.949101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.950999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.027170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1322/2626] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:31.030382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.042182 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4cc7-90e7-4000-80db-de6ccf201156 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.046881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.049565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.049565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.049565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.049565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.050515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.061073 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1323/2627] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:31.065206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.075245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ad59b-462d-413c-8f7f-de88abb847d1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.077905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:31.080024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.080927 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.086524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.086524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] PATH_INFO: `/v3/projects/7018dc1122844969b1dacf119144cbe6/users/7f4293ee8c954be9ba80fae481bbd520/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.086917 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1305/2628] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:31.089468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.098604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7018dc1122844969b1dacf119144cbe6, user_id=7f4293ee8c954be9ba80fae481bbd520, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.101304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.150953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872817a-3402-45f2-a683-35d272131894 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.155541 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.156208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.156493 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.156796 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.157476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.159377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.219136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1324/2629] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:31 2022] PUT /identity/v3/projects/7018dc1122844969b1dacf119144cbe6/users/7f4293ee8c954be9ba80fae481bbd520/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:31.222993 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.284581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e2db-87b5-4b7a-9c11-162f0ea6d350 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.289632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.290454 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.290762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.293585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.293585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.293585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.297081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1306/2630] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:31 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:31.298344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.307917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1325/2631] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:31.309193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77fba-0ca9-410e-a194-0752410c8212 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.309931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.313967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.314738 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.315018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.315289 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.316146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.317773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.319695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f79d72-7ca7-4d92-9a09-58308c6fbc82 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.326283 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.327227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.328416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.328721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] PATH_INFO: `/v3/projects/7018dc1122844969b1dacf119144cbe6/users/7f4293ee8c954be9ba80fae481bbd520/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.330901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7018dc1122844969b1dacf119144cbe6, user_id=7f4293ee8c954be9ba80fae481bbd520, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.332855 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1307/2632] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:31.333741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa740e4-019e-4df2-a13b-95e544a741c9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.342382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.345613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1326/2633] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:31 2022] PUT /identity/v3/projects/7018dc1122844969b1dacf119144cbe6/users/7f4293ee8c954be9ba80fae481bbd520/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:31.353506 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca7c7-ba34-417d-a035-38998acf9fef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.358557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.359210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.359210 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.387382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] MFA Rules not processed for user `7f4293ee8c954be9ba80fae481bbd520`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:31.388599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:31.392676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:31.412065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.412830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.413117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.413400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.414231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.415905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.425795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1308/2634] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:31.430453 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.439919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56291-dd43-4112-8c10-aee3629a270b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.445316 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.446391 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.447012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.447570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] PATH_INFO: `/v3/projects/7e2732b6787e4132a74777b00567e9d5/users/9811824bfe694897a247e8afa370d8ef/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.459573 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1327/2635] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:31.463352 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2732b6787e4132a74777b00567e9d5, user_id=9811824bfe694897a247e8afa370d8ef, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.466121 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.471830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.473264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:31.535610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31062faf-d257-46e9-80b9-9df09bc899c4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.539812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.540483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.540804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.541083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.550616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.552191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b050-4785-4d10-a345-703dac70458e service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.561925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1328/2636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:31.617739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1309/2637] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:31 2022] PUT /identity/v3/projects/7e2732b6787e4132a74777b00567e9d5/users/9811824bfe694897a247e8afa370d8ef/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:31.629055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.629055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.629055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.645605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:31.646383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:31.694163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.708381 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1329/2638] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:31.718485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:31.719884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:31.756377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bf9d-051f-4f34-bcef-07ec3ea91f73 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.761964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.762848 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.763131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.763417 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] PATH_INFO: `/v3/users/8dbe3fa62715439185f01f8309e3dffa` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.764639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbe3fa62715439185f01f8309e3dffa)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.766646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.778322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5278-7abe-4e0a-9709-b86184175249 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:31.783166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:31.783983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:31.784533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:31.784974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:31.796515 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:31.798044 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e27b1-6037-462b-9224-5d306c538650 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:31.807555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1330/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:31.957395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbe3fa62715439185f01f8309e3dffa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:31.958091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbe3fa62715439185f01f8309e3dffa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:31.958736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbe3fa62715439185f01f8309e3dffa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:31.966832 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbe3fa62715439185f01f8309e3dffa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:32.011545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:32.116216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbe3fa62715439185f01f8309e3dffa'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:32.119152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:32.138335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1310/2640] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:31 2022] DELETE /identity/v3/users/8dbe3fa62715439185f01f8309e3dffa => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:32.142930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:32.143245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:32.143590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:32.162133 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:32.163424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:32.226421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1331/2641] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:32.235810 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:32.237387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:32.294519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943f5d-c040-48e4-b4f2-df8400d3cc44 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:32.298368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:32.299011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:32.299294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:32.299570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:32.309383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:32.310918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:32.320868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1311/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:32.935216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:32.936737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:32.951723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f756-0228-48e7-be1c-876b8a280138 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:32.956464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:32.957388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:32.957676 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:32.957956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] PATH_INFO: `/v3/projects/1b749756ab974d758884c87e1b115ad3` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:32.959229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b749756ab974d758884c87e1b115ad3)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:32.961375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:33.112150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b749756ab974d758884c87e1b115ad3', 'request_id': 'req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.200009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b749756ab974d758884c87e1b115ad3', 'request_id': 'req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.207154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b749756ab974d758884c87e1b115ad3', 'request_id': 'req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.217613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] The token cache is being invalidate because project 1b749756ab974d758884c87e1b115ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:33.217901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.218533 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.220069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1332/2643] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:32 2022] DELETE /identity/v3/projects/1b749756ab974d758884c87e1b115ad3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:33.224037 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:33.234190 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899bdc-ecf0-4ff2-aa39-0361892aba3a service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:33.290556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:33.291439 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:33.292657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:33.292657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] PATH_INFO: `/v3/users/7f4293ee8c954be9ba80fae481bbd520` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:33.293260 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4293ee8c954be9ba80fae481bbd520)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:33.295183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:33.317670 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:33.568993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4293ee8c954be9ba80fae481bbd520'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.569655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4293ee8c954be9ba80fae481bbd520'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.570298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4293ee8c954be9ba80fae481bbd520'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.577304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4293ee8c954be9ba80fae481bbd520'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.657317 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4555fba9-b47b-48b1-9520-4c7a56397fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4293ee8c954be9ba80fae481bbd520'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:33.677683 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1312/2644] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:33 2022] DELETE /identity/v3/users/7f4293ee8c954be9ba80fae481bbd520 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:34.460749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:34.462530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:34.480837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b9cb3-7438-46c7-9dd7-38c7324de08c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:34.574125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:34.575005 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:34.575295 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:34.575575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] PATH_INFO: `/v3/projects/7018dc1122844969b1dacf119144cbe6` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:34.576836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7018dc1122844969b1dacf119144cbe6)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:34.579989 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:34.591387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:34.737779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7018dc1122844969b1dacf119144cbe6', 'request_id': 'req-0da87a68-afdd-4186-a9af-46c215f09306'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:34.817206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7018dc1122844969b1dacf119144cbe6', 'request_id': 'req-0da87a68-afdd-4186-a9af-46c215f09306'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:34.824893 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7018dc1122844969b1dacf119144cbe6', 'request_id': 'req-0da87a68-afdd-4186-a9af-46c215f09306'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:34.841186 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] The token cache is being invalidate because project 7018dc1122844969b1dacf119144cbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:34.841484 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:34.842154 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-0da87a68-afdd-4186-a9af-46c215f09306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:34.843702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1333/2645] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:34 2022] DELETE /identity/v3/projects/7018dc1122844969b1dacf119144cbe6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:34.848784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:34.849234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:34.849234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:34.870701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:34.872231 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:34.966896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1313/2646] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:34.976029 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd612-83da-47fc-8c77-342c3138450e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:34.977056 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd612-83da-47fc-8c77-342c3138450e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:34.977653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd612-83da-47fc-8c77-342c3138450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.001253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-557dd612-83da-47fc-8c77-342c3138450e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:35.002609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-557dd612-83da-47fc-8c77-342c3138450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:35.035481 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1334/2647] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:35.039840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.055080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad67d0a-4959-4adc-ae98-6ef10f7b8ec3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.058327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.059350 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.059744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.060131 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.061110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:35.061570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.063307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.079819 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1314/2648] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:35.084626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dd612-83da-47fc-8c77-342c3138450e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.101034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dd612-83da-47fc-8c77-342c3138450e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.101034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.101034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.101034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.101459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.102075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.104619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.212047 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1335/2649] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:35 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:35.213569 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.227437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0bd5-a1c6-4ca6-84ce-3b8348fef272 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.299229 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.299975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.300269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.300549 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.301303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.303230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.384690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1315/2650] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:35 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:35.388804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.401530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042ec5b-a29e-47a3-bee8-3e95271ab8a1 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.407827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.408783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.409175 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.409580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.410474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.412489 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.424624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1336/2651] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:35.428662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.441993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aaebf-2eb5-4a29-b02b-c964eb5e1651 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.458911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.459618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.460081 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.460370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.461193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.464025 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25004887-8b21-4c37-983b-f3dd62f37df7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.476092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:35.483154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1316/2652] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:35.489087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.502278 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46245-e40a-4e8d-b1ef-a4362d8e8095 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.509510 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.510447 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.510734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.511011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] PATH_INFO: `/v3/projects/1f82fe0a4ac645439c99fc92c76a5be5/users/cd303ddb541e486d82a4cb3d3339c66f/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.528184 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f82fe0a4ac645439c99fc92c76a5be5, user_id=cd303ddb541e486d82a4cb3d3339c66f, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.531082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.630627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1337/2653] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:35 2022] PUT /identity/v3/projects/1f82fe0a4ac645439c99fc92c76a5be5/users/cd303ddb541e486d82a4cb3d3339c66f/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:35.641394 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.641692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.641977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.669789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] MFA Rules not processed for user `cd303ddb541e486d82a4cb3d3339c66f`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:35.671023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:35.740827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1317/2654] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:35.746505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.817244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d48d5-ce77-428e-81ee-8e845df19371 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.822659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.823350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.823639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.823918 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.824792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.826771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.951648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1338/2655] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:35 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:35.959425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.971163 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726b18-b40b-41c2-9690-1b9f7cc94718 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.036416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.037257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.037609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.037953 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.039568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.041949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:36.142782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1318/2656] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:35 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:36.144842 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:36.157022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87e58-554e-4e07-b4fb-6facf8a5966b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.162140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.162813 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.163103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.163412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.164835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.166495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:36.177753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1339/2657] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:36.182672 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:36.194400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213dac-9586-45b8-956b-3fbd92d6ebad admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.199583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.200574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.201000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.201384 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.202253 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.204164 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0640ea-b9a2-4bc2-9dcb-ad126596efe0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:36.220023 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1319/2658] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:36.222270 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:36.235397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc15e5-ec49-4661-ab87-1d492b1d84f2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.240771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.241692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.242608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.243025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] PATH_INFO: `/v3/projects/3e7e6acc810a4ab28682fbffb24de143/users/2aaa3b61d3464b4abe4fba1ab41794f2/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.262705 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7e6acc810a4ab28682fbffb24de143, user_id=2aaa3b61d3464b4abe4fba1ab41794f2, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.265379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:36.408754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1340/2659] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:36 2022] PUT /identity/v3/projects/3e7e6acc810a4ab28682fbffb24de143/users/2aaa3b61d3464b4abe4fba1ab41794f2/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:36.435565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:36.475582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.475889 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.476172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.504718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] MFA Rules not processed for user `2aaa3b61d3464b4abe4fba1ab41794f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:36.505955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:36.579580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1320/2660] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:36.583959 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:36.682951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3219-aae8-4348-b558-17aa473e66c4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.692930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.697532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.698373 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.699153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.700105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.705644 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:36.859388 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1341/2661] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:36 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:36.864438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:36.890655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea04d-45b9-4407-a930-945ecc6ff06f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:36.981018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:36.983424 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:36.983802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:36.984165 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:36.985049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:36.988112 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.127894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:37.136881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1321/2662] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:36 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:37.140810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d2c8a-d909-475d-b779-2902d201e1a8 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:37.147831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:37.149261 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.149561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.149845 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.151289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:37.153495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.165892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1342/2663] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:37.170030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:37.178536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:37.184488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17fb-6670-4a14-837e-2e47584ccf7b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:37.190963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:37.191909 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.192197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.192477 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] PATH_INFO: `/v3/projects/e1b9cf7945ed4769a7409a254faafaa4/users/71ce64cde08a41b18321354a74592827/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.209337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b9cf7945ed4769a7409a254faafaa4, user_id=71ce64cde08a41b18321354a74592827, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:37.212921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.395788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1322/2664] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:37 2022] PUT /identity/v3/projects/e1b9cf7945ed4769a7409a254faafaa4/users/71ce64cde08a41b18321354a74592827/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:37.405750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:37.413603 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ab9c-9183-4499-be12-c21ecc5da23b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:37.492341 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:37.493249 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.493537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.493817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.494552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:37.496421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcdb7-1472-4d8a-b2f0-dd875924c2c4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.506486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1343/2665] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:37.513089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:37.524863 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa85b-92e0-4d54-9595-1d2f0cbecc25 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:37.531033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:37.549054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.549054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.549054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] PATH_INFO: `/v3/projects/e1b9cf7945ed4769a7409a254faafaa4/users/71ce64cde08a41b18321354a74592827/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.549054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b9cf7945ed4769a7409a254faafaa4, user_id=71ce64cde08a41b18321354a74592827, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:37.549054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.551158 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1323/2666] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:37 2022] PUT /identity/v3/projects/e1b9cf7945ed4769a7409a254faafaa4/users/71ce64cde08a41b18321354a74592827/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:37.561606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b806-1a77-4f94-8631-7cb46135fb1d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.561894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b806-1a77-4f94-8631-7cb46135fb1d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.562256 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b806-1a77-4f94-8631-7cb46135fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.592658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ac14b806-1a77-4f94-8631-7cb46135fb1d None None] MFA Rules not processed for user `71ce64cde08a41b18321354a74592827`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:37.594819 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ac14b806-1a77-4f94-8631-7cb46135fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:37.682579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1344/2667] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:37.697141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:37.699098 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:37.771694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f127-cac0-441b-a4c5-8b1c81e9f90d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:37.775996 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:37.776956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:37.777463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:37.777875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:37.845258 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:37.847159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:37.858606 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1324/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:38.161824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:38.265984 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:38.266276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:38.266605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:38.304251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] MFA Rules not processed for user `9811824bfe694897a247e8afa370d8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:38.304251 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:38.378264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1345/2669] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:38.383511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:38.385409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:38.390894 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:38.456194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edecbd-5963-4efd-9273-b7b28afd0d22 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:38.460609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:38.461382 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:38.461667 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:38.461939 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:38.462640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:38.464523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:38.606752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1325/2670] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:38 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:38.610747 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:38.627092 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f52d-27f0-45e4-9d31-fa2d75b27dff None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:38.726818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:38.728360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:38.728647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:38.728978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:38.729678 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:38.731679 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:38.848744 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1346/2671] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:38 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:38.851643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:38.863174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041a6c-7801-423a-834d-0beafd047099 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:38.869214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:38.870357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:38.870851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:38.873122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:38.873122 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:38.873626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:38.886340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1326/2672] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:38.890694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:38.901194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0860-7f83-4d32-b532-1c5c3fcff0b0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:38.905846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:38.906749 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:38.907021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:38.907292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] PATH_INFO: `/v3/projects/c00668c6b0524087a14d740eed033a5f/users/629d2001827c40bb956bf4df3a32bd9d/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:38.922247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00668c6b0524087a14d740eed033a5f, user_id=629d2001827c40bb956bf4df3a32bd9d, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:38.925122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:39.034465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1347/2673] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:38 2022] PUT /identity/v3/projects/c00668c6b0524087a14d740eed033a5f/users/629d2001827c40bb956bf4df3a32bd9d/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:39.038452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:39.048775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c169-3c3a-46a9-b795-497440700502 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:39.109356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:39.110200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:39.110504 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:39.110950 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:39.111701 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:39.113360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:39.127038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1327/2674] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:39.131404 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:39.142112 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfba54-2356-49a0-9c05-435a024f1870 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:39.147685 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:39.148837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:39.149127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:39.149463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] PATH_INFO: `/v3/projects/c00668c6b0524087a14d740eed033a5f/users/629d2001827c40bb956bf4df3a32bd9d/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:39.151444 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00668c6b0524087a14d740eed033a5f, user_id=629d2001827c40bb956bf4df3a32bd9d, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:39.154437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:39.168713 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1348/2675] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:39 2022] PUT /identity/v3/projects/c00668c6b0524087a14d740eed033a5f/users/629d2001827c40bb956bf4df3a32bd9d/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:40.098469 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:40.160246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44ab3-3cbd-4767-a449-283838470ffc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:40.189983 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:40.226633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:40.228193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:40.228733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:40.229542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:40.295610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:40.297172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87028ab3-552d-45a1-8a21-c1fdb51d8303 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:40.306827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1328/2676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:42.506440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:42.517407 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e77-3809-4585-b2e0-81cf400c94fe admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:42.521838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:42.522754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:42.523732 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:42.524174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:42.548041 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:42.589953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:42.594650 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:42.603318 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1349/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:45.565774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:45.566339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:45.566339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:45.594246 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] MFA Rules not processed for user `629d2001827c40bb956bf4df3a32bd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:45.595484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:45.667467 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1329/2678] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:45.682064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:45.687812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:45.767847 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70d97-ea12-44b7-afb5-805610f2cfe7 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:45.773923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:45.774592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:45.774887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:45.775171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:45.839522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:45.841168 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fffd97-829d-4949-8909-db6bb4320638 service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:45.850359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1350/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:48.848784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:48.927775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2a25-aa8c-4e80-b37c-8dfdfd8d5f8b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:48.933320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:48.934293 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:48.934583 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:48.934866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] PATH_INFO: `/v3/users/cd303ddb541e486d82a4cb3d3339c66f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:48.936209 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd303ddb541e486d82a4cb3d3339c66f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:48.938367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:48.953423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:49.205614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd303ddb541e486d82a4cb3d3339c66f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:49.206443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd303ddb541e486d82a4cb3d3339c66f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:49.207137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd303ddb541e486d82a4cb3d3339c66f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:49.218421 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd303ddb541e486d82a4cb3d3339c66f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:49.320188 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c21a9581-a352-474a-8b76-71071c92d28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd303ddb541e486d82a4cb3d3339c66f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:49.333797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:49.334376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:49.334633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:49.347572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1330/2680] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:48 2022] DELETE /identity/v3/users/cd303ddb541e486d82a4cb3d3339c66f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:49.352633 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:49.355669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:49.355669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:49.357898 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] MFA Rules not processed for user `9811824bfe694897a247e8afa370d8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:49.359127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:49.372725 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:49.373934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:49.415325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:49.422767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1351/2681] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:49.435619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1331/2682] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:49.445304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:49.446722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:49.506015 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f5e6-e804-48f6-bf0b-7c4662570f17 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:49.509922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:49.510583 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:49.510875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:49.511155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:49.521155 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:49.523148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:49.533109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1352/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:50.020145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:50.022374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:50.036816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4b692-0c28-4eb4-bb75-6c84fe117bf3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:50.041748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:50.042631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:50.042921 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:50.043202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] PATH_INFO: `/v3/projects/1f82fe0a4ac645439c99fc92c76a5be5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:50.044605 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f82fe0a4ac645439c99fc92c76a5be5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:50.046695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:50.173026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f82fe0a4ac645439c99fc92c76a5be5', 'request_id': 'req-63266145-e35d-47d9-85ad-0cb4e835c70d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.322783 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f82fe0a4ac645439c99fc92c76a5be5', 'request_id': 'req-63266145-e35d-47d9-85ad-0cb4e835c70d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.330904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f82fe0a4ac645439c99fc92c76a5be5', 'request_id': 'req-63266145-e35d-47d9-85ad-0cb4e835c70d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.343358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] The token cache is being invalidate because project 1f82fe0a4ac645439c99fc92c76a5be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:50.346220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.346220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.346220 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1332/2684] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:50 2022] DELETE /identity/v3/projects/1f82fe0a4ac645439c99fc92c76a5be5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:50.350366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:50.360913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c02e-b5d3-4f3a-a81d-006d416558b9 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:50.422122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:50.423519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:50.423746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:50.424034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] PATH_INFO: `/v3/users/2aaa3b61d3464b4abe4fba1ab41794f2` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:50.425693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aaa3b61d3464b4abe4fba1ab41794f2)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:50.428076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:50.718050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aaa3b61d3464b4abe4fba1ab41794f2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.724884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aaa3b61d3464b4abe4fba1ab41794f2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.725542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aaa3b61d3464b4abe4fba1ab41794f2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.726691 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aaa3b61d3464b4abe4fba1ab41794f2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.840736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aaa3b61d3464b4abe4fba1ab41794f2'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.860402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1353/2685] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:50 2022] DELETE /identity/v3/users/2aaa3b61d3464b4abe4fba1ab41794f2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:51.340089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:51.341748 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:51.357590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266145-e35d-47d9-85ad-0cb4e835c70d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:51.367947 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:51.422978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:51.423849 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:51.424130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:51.424436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] PATH_INFO: `/v3/projects/3e7e6acc810a4ab28682fbffb24de143` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:51.425658 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7e6acc810a4ab28682fbffb24de143)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:51.427609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:51.560795 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7e6acc810a4ab28682fbffb24de143', 'request_id': 'req-b3389711-60d9-4a70-94cc-9ef1419677f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.675479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7e6acc810a4ab28682fbffb24de143', 'request_id': 'req-b3389711-60d9-4a70-94cc-9ef1419677f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.683200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7e6acc810a4ab28682fbffb24de143', 'request_id': 'req-b3389711-60d9-4a70-94cc-9ef1419677f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.693646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] The token cache is being invalidate because project 3e7e6acc810a4ab28682fbffb24de143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:51.694011 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.695429 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.697690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1333/2686] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:51 2022] DELETE /identity/v3/projects/3e7e6acc810a4ab28682fbffb24de143 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:51.703166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:51.704796 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:51.717702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29328b-2135-4ac6-aefd-b65335c6c99c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:51.735294 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:51.777711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:51.778588 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:51.778869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:51.779139 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] PATH_INFO: `/v3/users/71ce64cde08a41b18321354a74592827` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:51.780322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ce64cde08a41b18321354a74592827)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:51.782387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:52.016080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ce64cde08a41b18321354a74592827'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.023768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ce64cde08a41b18321354a74592827'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.024844 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ce64cde08a41b18321354a74592827'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.029451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ce64cde08a41b18321354a74592827'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.235002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d50953b9-5126-4a63-9b31-e263dfcbb8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ce64cde08a41b18321354a74592827'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.255770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1354/2687] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:51 2022] DELETE /identity/v3/users/71ce64cde08a41b18321354a74592827 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:52.768709 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:52.770491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:52.789234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389711-60d9-4a70-94cc-9ef1419677f0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:52.847851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:52.848753 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:52.849084 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:52.849360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] PATH_INFO: `/v3/projects/e1b9cf7945ed4769a7409a254faafaa4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:52.850581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b9cf7945ed4769a7409a254faafaa4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:52.852520 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:52.969538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:52.972951 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b9cf7945ed4769a7409a254faafaa4', 'request_id': 'req-0ce2f031-3567-41c9-ac75-79aa73a916e6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:53.081270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b9cf7945ed4769a7409a254faafaa4', 'request_id': 'req-0ce2f031-3567-41c9-ac75-79aa73a916e6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:53.088008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b9cf7945ed4769a7409a254faafaa4', 'request_id': 'req-0ce2f031-3567-41c9-ac75-79aa73a916e6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:53.098199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] The token cache is being invalidate because project e1b9cf7945ed4769a7409a254faafaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:53.098483 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:53.099135 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ce2f031-3567-41c9-ac75-79aa73a916e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:53.101304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1334/2688] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:52 2022] DELETE /identity/v3/projects/e1b9cf7945ed4769a7409a254faafaa4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:53.106665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.107574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.107894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.126835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:53.128045 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.198965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1355/2689] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.206782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.207078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.207360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.227677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:53.228949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.237396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1335/2690] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.242428 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.252785 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7613-9487-4f62-8b1e-0e7d0a886640 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.258099 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.258776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.259069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.259384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.260148 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:53.260461 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.262314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.275240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1356/2691] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:53.279646 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.289136 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f37fb-cc59-4cb1-9d04-823f328fd323 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.294636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.295307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.295602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.295884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.296836 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.299050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.445367 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1336/2692] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:53.447508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.459387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcf66-eb3e-4a6b-917e-ec287c6ee6b0 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.488502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:53.521616 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.522609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.522609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.523022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.523775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.526205 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.674173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1357/2693] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:53.678548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.690265 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cdb14-9329-49b7-b5c5-2ed8eec034da admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.695201 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.695888 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.696177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.696457 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.697236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.698884 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.709740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1337/2694] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:53.713965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.725741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712566e7-3c4c-4720-ac6e-dd2c8acfceed admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.731877 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.732841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.733202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.733557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.734398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.736080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53529-82c9-4339-864f-6937f7113a91 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.748091 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1358/2695] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:53.752055 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.763242 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883335-87bc-4edd-8a05-84e1b45b2514 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.767222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.768123 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.768408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.768720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] PATH_INFO: `/v3/projects/ba9a225950ec47069abf0f51e8ff7a05/users/300c7b2a849e4fc8a39bdab8564b5291/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.786101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9a225950ec47069abf0f51e8ff7a05, user_id=300c7b2a849e4fc8a39bdab8564b5291, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.787148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.873933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1338/2696] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:53 2022] PUT /identity/v3/projects/ba9a225950ec47069abf0f51e8ff7a05/users/300c7b2a849e4fc8a39bdab8564b5291/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:53.883570 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7636e9-ecf4-49d1-b6f8-ed870b2e432e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.883868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7636e9-ecf4-49d1-b6f8-ed870b2e432e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.884152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7636e9-ecf4-49d1-b6f8-ed870b2e432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.901631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-df7636e9-ecf4-49d1-b6f8-ed870b2e432e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:53.902835 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-df7636e9-ecf4-49d1-b6f8-ed870b2e432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.962873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1359/2697] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.972401 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.974127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:54.034501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296cf-659f-42e1-af6e-3cc95e238efd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.038266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.039420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.039702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.039980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.049287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.050724 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.060130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1339/2698] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:55.504811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6fdb-b03c-4306-95a1-769c61de3597 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:55.505309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6fdb-b03c-4306-95a1-769c61de3597 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:55.505429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6fdb-b03c-4306-95a1-769c61de3597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:55.537050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-cd6f6fdb-b03c-4306-95a1-769c61de3597 None None] MFA Rules not processed for user `300c7b2a849e4fc8a39bdab8564b5291`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:55.540076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-cd6f6fdb-b03c-4306-95a1-769c61de3597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:55.624416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1360/2699] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:55.635508 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:55.636972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:55.694070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ed10-e4dc-41a4-ab72-908d7a1fa9b1 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:55.698860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:55.699511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:55.700147 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:55.700427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:55.713169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:55.714686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:55.723723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1340/2700] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:58.687716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:58.688203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:58.688203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:58.709156 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] MFA Rules not processed for user `300c7b2a849e4fc8a39bdab8564b5291`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:58.710958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:58.718806 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1361/2701] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:58.757560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:58.759659 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:58.776192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:58.825090 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08289e77-2d45-42cc-88bd-d926fd0037b9 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:58.828715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:58.832113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:58.832113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:58.832113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:58.832113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:58.918594 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:58.920048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:58.931564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1341/2702] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:59.538863 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:59.550498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3090-0988-457a-a4f1-0a9e150e9c3f None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:59.554254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:59.555721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:59.556011 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:59.556293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:59.558731 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:59.573220 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:59.574654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:59.585799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1362/2703] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:09.166403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=48 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:09.580812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:10.449632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:10.451427 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:10.526422 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde1009-51dd-43f6-b3e2-64aa3f16b8c4 service glance] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:10.531903 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:10.532492 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:10.532830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:10.533363 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:10.535226 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:10.548390 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:10.550113 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a963b3-f176-4bd4-878f-b00eb9d51a74 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:10.561911 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1342/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:12.927411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:12.928884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:12.942366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dfcc8-b3f5-469b-8c3f-3ce2c83b42b4 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:12.946904 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:12.947779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:12.948974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:12.949362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] PATH_INFO: `/v3/users/637e37c02a1f4c2cbfc443b4afcf1281` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:12.950551 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637e37c02a1f4c2cbfc443b4afcf1281)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:12.952479 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.181007 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637e37c02a1f4c2cbfc443b4afcf1281'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:13.189346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637e37c02a1f4c2cbfc443b4afcf1281'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:13.190051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637e37c02a1f4c2cbfc443b4afcf1281'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:13.190677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637e37c02a1f4c2cbfc443b4afcf1281'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:13.372549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637e37c02a1f4c2cbfc443b4afcf1281'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:13.392095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1363/2705] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:12 2022] DELETE /identity/v3/users/637e37c02a1f4c2cbfc443b4afcf1281 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:13.396629 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.397195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.397685 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.415410 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:13.416856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:13.478538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1343/2706] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:13.488460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.489943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:13.554628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed71a1-bb38-4a8d-93f3-b8bbbd04bea6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.559125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.559789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.560216 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.560482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.570564 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.572017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.585034 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1364/2707] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:14.029263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:14.029263 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:14.039086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060d544-3d65-4a92-8291-5fcaa1b6c1ad None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:14.044964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:14.045842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:14.046125 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:14.046402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] PATH_INFO: `/v3/projects/57947fa135254fb996f403d5733a2659` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:14.047602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57947fa135254fb996f403d5733a2659)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:14.049597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:14.167572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57947fa135254fb996f403d5733a2659', 'request_id': 'req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.263425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57947fa135254fb996f403d5733a2659', 'request_id': 'req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.275396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57947fa135254fb996f403d5733a2659', 'request_id': 'req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.286160 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] The token cache is being invalidate because project 57947fa135254fb996f403d5733a2659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:14.286458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.287206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.289007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1344/2708] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:14 2022] DELETE /identity/v3/projects/57947fa135254fb996f403d5733a2659 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:14.292751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:14.302829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab583-6679-437d-8203-045cd86423cf service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:14.363059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:14.364013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:14.364298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:14.364585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] PATH_INFO: `/v3/users/d4c2369db3da495caf24a0c4c7a6a74b` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:14.365873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c2369db3da495caf24a0c4c7a6a74b)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:14.367955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:14.386057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:14.576649 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c2369db3da495caf24a0c4c7a6a74b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.585032 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c2369db3da495caf24a0c4c7a6a74b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.585768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c2369db3da495caf24a0c4c7a6a74b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.586421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c2369db3da495caf24a0c4c7a6a74b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.675065 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e69d7913-b663-4cbc-8a8b-a60c485b493c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c2369db3da495caf24a0c4c7a6a74b'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:14.695149 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1365/2709] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:14 2022] DELETE /identity/v3/users/d4c2369db3da495caf24a0c4c7a6a74b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:15.209395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:15.211868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:15.228458 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a352ca-3e6b-43db-a8d2-1b82c3b3494b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:15.249351 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:15.316298 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:15.318571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:15.318571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:15.318571 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] PATH_INFO: `/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:15.319059 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b3544fdf2c40e28102db6f9ac84f5b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:15.321015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:15.496754 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b3544fdf2c40e28102db6f9ac84f5b', 'request_id': 'req-199a1fb3-332b-4b46-9f22-9474586b3c45'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:15.604813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b3544fdf2c40e28102db6f9ac84f5b', 'request_id': 'req-199a1fb3-332b-4b46-9f22-9474586b3c45'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:15.611377 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b3544fdf2c40e28102db6f9ac84f5b', 'request_id': 'req-199a1fb3-332b-4b46-9f22-9474586b3c45'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:15.622426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] The token cache is being invalidate because project e4b3544fdf2c40e28102db6f9ac84f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:15.622711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:15.623338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-199a1fb3-332b-4b46-9f22-9474586b3c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:15.624922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1345/2710] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:15 2022] DELETE /identity/v3/projects/e4b3544fdf2c40e28102db6f9ac84f5b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:15.630010 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:15.630483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:15.630587 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:15.648358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:15.649574 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:15.708436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1366/2711] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:15.717399 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:15.717696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:15.717980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:15.736166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:15.737409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:15.746156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1346/2712] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:15.750700 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:15.760386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5539b-e1f0-486a-8438-4db2e11550b4 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:15.765783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:15.766437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:15.766743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:15.766999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:15.767724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:15.768037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:15.769658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:15.781185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1367/2713] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:15.785488 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:15.795078 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d86c6-d770-40ab-8fb2-fe40f5e8f9b4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:15.799789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:15.800431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:15.800745 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:15.801140 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:15.801824 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:15.803702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:15.928114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1347/2714] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:15 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:15.933097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:15.943348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8ec0-ad31-4d3a-b20b-739be9250ff9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.001142 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.001829 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.002116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.002394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.003101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.005082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.081423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1368/2715] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:15 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:16.085521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.096096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2b94-5a4b-40ca-9776-462aca816724 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.100815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.101486 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.101770 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.102045 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.102777 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.104946 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.115681 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1348/2716] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:16.120380 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.130888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875b1f3-e426-46d9-86df-96343fa014d7 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.135894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.138325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.138325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.138325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.138325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.139613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded043d8-60f0-4349-8a87-579c26e26ca9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.145122 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:16.151620 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1369/2717] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:16.156355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.168015 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923cc7f-9c0d-4a21-bf9a-fcf9ecd183a6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.172865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.173769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.174067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.174328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] PATH_INFO: `/v3/projects/505cb2e0165f47759ac20cf01f362454/users/80955ecdcafc4f4580bc8a0144a5c84d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.194666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=505cb2e0165f47759ac20cf01f362454, user_id=80955ecdcafc4f4580bc8a0144a5c84d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.197565 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.264811 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1349/2718] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:16 2022] PUT /identity/v3/projects/505cb2e0165f47759ac20cf01f362454/users/80955ecdcafc4f4580bc8a0144a5c84d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:16.275580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.276401 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.276711 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.310245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] MFA Rules not processed for user `80955ecdcafc4f4580bc8a0144a5c84d`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:16.313088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:16.390441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1370/2719] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:16.395155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.439027 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:16.457799 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4847b80-35aa-4fc1-a776-f658b25bc803 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.462505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.463181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.464021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.464335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.465082 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.467038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.567943 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1350/2720] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:16 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:16.573236 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.586742 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbca17b-a00f-4344-9bbe-503d1081ba4d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.661992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.663462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.663929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.664440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.665377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.672576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.762046 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1371/2721] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:16 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:16.765962 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.777568 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9da88-b5e9-49ea-b93a-31f19a1d3781 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.783806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.787604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.787604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.787604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.787604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.787948 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.802330 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1351/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:09:16.806095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.819399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c4135-7456-4c57-b5b0-7d8c19f7a83a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:16.825024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:16.825931 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:16.826221 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:16.826490 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] PATH_INFO: `/v3/projects/18b576fa95c94e33bececd4bc248c582/users/d9082f09d68c4541b6552a62196f95a1/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:16.844949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b576fa95c94e33bececd4bc248c582, user_id=d9082f09d68c4541b6552a62196f95a1, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:16.845624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:16.941058 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1372/2723] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:16 2022] PUT /identity/v3/projects/18b576fa95c94e33bececd4bc248c582/users/d9082f09d68c4541b6552a62196f95a1/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:16.945000 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:16.961597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677b0f-7ba7-496e-9461-c53e6335f165 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:17.028475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:17.029194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.029967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.029967 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.030463 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:17.032086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b4fbe-8bb4-44a9-bf9c-93f9e7fa79c1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:17.048324 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:17.050831 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1352/2724] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:17.062502 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699656a-ea1d-4eb4-9054-e653c54ce642 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:17.067727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:17.068884 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.069171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.069758 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] PATH_INFO: `/v3/projects/18b576fa95c94e33bececd4bc248c582/users/d9082f09d68c4541b6552a62196f95a1/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.071958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b576fa95c94e33bececd4bc248c582, user_id=d9082f09d68c4541b6552a62196f95a1, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:17.076728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:17.101639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.101930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.102212 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.103629 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1373/2725] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:17 2022] PUT /identity/v3/projects/18b576fa95c94e33bececd4bc248c582/users/d9082f09d68c4541b6552a62196f95a1/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:17.131780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] MFA Rules not processed for user `d9082f09d68c4541b6552a62196f95a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:17.133008 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:17.212710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:17.214665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:17.251154 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1353/2726] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:17.265484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:17.268839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:17.280581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:17.313909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071fe3-8694-4fe1-bfbe-ae65ce0159d4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:17.321392 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:17.334268 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.339563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.339563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.339563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:17.341491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:17.362784 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede375d-04e3-42d0-9db0-2680378f7b36 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:17.367932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:17.369146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.369556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.370694 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.378910 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:17.380888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:17.388906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:17.391365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:17.394997 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1374/2727] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:09:17.406320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1354/2728] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:17.639751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:17.650089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dea436-d3fd-42f8-aa84-4d8e487ead9c service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:17.655548 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:17.658086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:17.658378 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:17.658664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:17.729911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:17.731505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1b54-ab8f-4532-9f56-cd4253d98584 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:17.742379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1375/2729] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:17.962320 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:17.964919 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:18.025494 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20ac5-a8e1-4b84-80f7-003c62d70d4a service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:18.029908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:18.030561 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:18.030846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:18.031139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:18.032949 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:18.042955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:18.044408 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:18.052338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1355/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:18.859855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58395-38a0-46df-af42-139453b59311 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:18.860354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58395-38a0-46df-af42-139453b59311 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:18.860468 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58395-38a0-46df-af42-139453b59311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:18.877861 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-a8c58395-38a0-46df-af42-139453b59311 None None] MFA Rules not processed for user `300c7b2a849e4fc8a39bdab8564b5291`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:18.879102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-a8c58395-38a0-46df-af42-139453b59311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:18.934194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1376/2731] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:23.352346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:23.353934 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:23.372211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4645-aa49-489d-bef3-55f5b63c9313 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:23.379518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:23.380269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:23.380626 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:23.381013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:23.383311 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:23.397386 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:23.399217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779518-4cec-44f4-92a3-6716e29c607c service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:23.410977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1356/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:26.510846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c58395-38a0-46df-af42-139453b59311 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:26.588422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c58395-38a0-46df-af42-139453b59311 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:26.593420 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:26.594680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:26.595094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:26.595374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] PATH_INFO: `/v3/users/80955ecdcafc4f4580bc8a0144a5c84d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:26.596579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80955ecdcafc4f4580bc8a0144a5c84d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:26.598526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:26.612271 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:26.801521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80955ecdcafc4f4580bc8a0144a5c84d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:26.808639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80955ecdcafc4f4580bc8a0144a5c84d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:26.809364 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80955ecdcafc4f4580bc8a0144a5c84d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:26.810025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80955ecdcafc4f4580bc8a0144a5c84d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:26.891443 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80955ecdcafc4f4580bc8a0144a5c84d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:26.908612 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1377/2733] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:26 2022] DELETE /identity/v3/users/80955ecdcafc4f4580bc8a0144a5c84d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:26.913191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:26.918657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:26.918657 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:26.935780 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:26.937906 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:26.999355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1357/2734] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:27.008999 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:27.010554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:27.072972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4a82-223e-4350-a85c-e97ec50795f4 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:27.076750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:27.077523 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:27.077812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:27.078086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:27.087801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:27.089289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:27.100536 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1378/2735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:27.477068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:27.479491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:27.501938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2412198-5dd6-402b-98b1-ed7d594968e3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:27.523955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:27.523955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:27.523955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:27.523955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] PATH_INFO: `/v3/projects/505cb2e0165f47759ac20cf01f362454` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:27.524475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] RBAC: Authorizing `identity:delete_project(project_id=505cb2e0165f47759ac20cf01f362454)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:27.524475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:27.699920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505cb2e0165f47759ac20cf01f362454', 'request_id': 'req-1e56a03e-258c-49db-afea-3620a0a2973c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:27.788510 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505cb2e0165f47759ac20cf01f362454', 'request_id': 'req-1e56a03e-258c-49db-afea-3620a0a2973c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:27.795392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505cb2e0165f47759ac20cf01f362454', 'request_id': 'req-1e56a03e-258c-49db-afea-3620a0a2973c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:27.797818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:27.806426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] The token cache is being invalidate because project 505cb2e0165f47759ac20cf01f362454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:27.806719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:27.807358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:27.808955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1358/2736] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:27 2022] DELETE /identity/v3/projects/505cb2e0165f47759ac20cf01f362454 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:27.813465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:27.823177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde2d-9405-4f5d-ac80-df71eec09343 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:27.879880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:27.880830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:27.881116 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:27.886191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] PATH_INFO: `/v3/users/d9082f09d68c4541b6552a62196f95a1` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:27.886191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9082f09d68c4541b6552a62196f95a1)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:27.886191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:28.071004 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:28.080547 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9082f09d68c4541b6552a62196f95a1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:28.087475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9082f09d68c4541b6552a62196f95a1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:28.088239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9082f09d68c4541b6552a62196f95a1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:28.088957 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9082f09d68c4541b6552a62196f95a1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:28.221575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-a7f79b76-0841-425f-92a8-d4a3dc697c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9082f09d68c4541b6552a62196f95a1'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:28.240340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1379/2737] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:27 2022] DELETE /identity/v3/users/d9082f09d68c4541b6552a62196f95a1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:28.659189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:28.660643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:28.674749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a03e-258c-49db-afea-3620a0a2973c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:28.731562 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:28.732428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:28.732741 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:28.733021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] PATH_INFO: `/v3/projects/18b576fa95c94e33bececd4bc248c582` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:28.735096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b576fa95c94e33bececd4bc248c582)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:28.737031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:28.896309 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b576fa95c94e33bececd4bc248c582', 'request_id': 'req-514f517a-ac2e-496f-9902-6fb788ea8ba9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:29.017620 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b576fa95c94e33bececd4bc248c582', 'request_id': 'req-514f517a-ac2e-496f-9902-6fb788ea8ba9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:29.024763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b576fa95c94e33bececd4bc248c582', 'request_id': 'req-514f517a-ac2e-496f-9902-6fb788ea8ba9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:29.036080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] The token cache is being invalidate because project 18b576fa95c94e33bececd4bc248c582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:29.036365 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:29.037048 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-514f517a-ac2e-496f-9902-6fb788ea8ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:29.038644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1359/2738] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:28 2022] DELETE /identity/v3/projects/18b576fa95c94e33bececd4bc248c582 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:29.043857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.044330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.044511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.062416 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:29.078030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.125024 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1380/2739] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:29.140923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.140923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.140923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.142096 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.143609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.156335 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:29.157897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.167297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1360/2740] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:29.171788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.181830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf815c-7449-451e-a8a6-4bfe839e4e75 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.186632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.188022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.188327 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.188604 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.189420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:29.189687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.193127 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.208108 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1361/2741] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:29.209755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.220614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20bb3-5227-492c-93c7-eec03c8a7edb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.225507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.226244 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.226640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.226989 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.227788 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.229976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.236723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfea05-7e42-4a4e-983e-0523ff647502 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.246529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.247359 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.247654 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.247962 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.250419 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.263384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.265693 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.276926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1381/2742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:29.391355 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1362/2743] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:29.392837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.407794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f2ad-76d4-46ae-b75a-f6c6096b5a3b service nova] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.443366 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:29.467311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.468067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.468360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.468703 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.469446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.471358 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.488923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.490727 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.534930 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:29.549560 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a803b3a-a507-46bc-aca9-b0011dc9a26f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.553252 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.553908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.554197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.554479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.556302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.601836 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1382/2744] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:29.602945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.614048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e844-5588-4727-9ade-0373235fafca admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.619319 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.620204 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.620426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.620776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.621063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.621886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.622016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.623397 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.633857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1363/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:09:29.639377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1383/2746] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:29.648585 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.659270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728febab-c0ac-4e60-b7ae-c8648d9b4435 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.664083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.664902 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.665287 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.665662 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.666512 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.668206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718b6f-da90-40ea-a26c-4501c8ba7325 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.682485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1364/2747] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:29.683631 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.694601 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82138a5-47c6-45ee-adb6-708052a41231 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.699254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.700257 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.700463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.700772 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] PATH_INFO: `/v3/projects/d29ab72deaaf4475bfaf22f31dd0fdd0/users/70734ce1fede4313ba2cdd17dbd1519c/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.720030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29ab72deaaf4475bfaf22f31dd0fdd0, user_id=70734ce1fede4313ba2cdd17dbd1519c, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.722899 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:29.793521 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1384/2748] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:29 2022] PUT /identity/v3/projects/d29ab72deaaf4475bfaf22f31dd0fdd0/users/70734ce1fede4313ba2cdd17dbd1519c/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:29.804054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.804430 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.804793 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.832088 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] MFA Rules not processed for user `70734ce1fede4313ba2cdd17dbd1519c`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:29.833342 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:29.904197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1365/2749] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:29.909566 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:29.982071 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2af8-eac0-46ba-bc6b-994b693d28f2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:29.987185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:29.988559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:29.988559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:29.988559 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:29.989495 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:29.991266 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.113753 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1385/2750] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:29 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:30.115480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.126865 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57623d4-8b2a-43e9-9550-cc5197cfbb9d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.184794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.185425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.185718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.186599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.187518 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.189455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.381882 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:30.388740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1366/2751] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:30 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:30.393499 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.404591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39172f6-d1fe-49be-a37e-63fe85ce4e0e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.410225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.410922 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.411239 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.411516 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.412264 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.413906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.425377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1386/2752] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:30.435992 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.440792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e186ff0-e195-4043-a985-9445ac78bbf1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.445648 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.446596 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.446881 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.447279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] PATH_INFO: `/v3/projects/cd4c024f9a094aa1aa57f17afe665646/users/14b6e4e4fcb54fe9ac95169fd420482c/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.464132 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c024f9a094aa1aa57f17afe665646, user_id=14b6e4e4fcb54fe9ac95169fd420482c, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.466839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.554010 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1367/2753] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:30 2022] PUT /identity/v3/projects/cd4c024f9a094aa1aa57f17afe665646/users/14b6e4e4fcb54fe9ac95169fd420482c/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:30.558176 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.568624 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe86f-aa08-4866-9f4d-29966b637262 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.627371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.628072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.628383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.628652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.629426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.631174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b37296-722f-4be7-a1a4-c148cf055f0b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.642178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1387/2754] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:30.646152 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.657187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ba47-0867-47fb-b626-1eeb50fc8816 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.662192 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.664202 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.664496 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.664813 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] PATH_INFO: `/v3/projects/cd4c024f9a094aa1aa57f17afe665646/users/14b6e4e4fcb54fe9ac95169fd420482c/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.666870 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c024f9a094aa1aa57f17afe665646, user_id=14b6e4e4fcb54fe9ac95169fd420482c, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.669760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.680491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1368/2755] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:30 2022] PUT /identity/v3/projects/cd4c024f9a094aa1aa57f17afe665646/users/14b6e4e4fcb54fe9ac95169fd420482c/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:30.692853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.693081 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.693372 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.699317 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:30.722288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] MFA Rules not processed for user `14b6e4e4fcb54fe9ac95169fd420482c`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:30.723512 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:30.792146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1388/2756] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:30.803941 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:30.805760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:30.867321 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193814a-0901-4b24-9d78-73ecbc88227a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:30.871587 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:30.872343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:30.872744 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:30.873029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:30.883181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:30.884627 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de1e4-9230-4616-acb2-0a5690881ced service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:30.895276 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1369/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:31.066466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:31.076189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20789eb-2e5d-4e45-9d35-8c33e5a6d69e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:31.080211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:31.080482 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:31.080802 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:31.081085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:31.147350 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:31.148894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:31.158971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1389/2758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:39.887926 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.890993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.890993 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.906448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:39.908102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:39.960774 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1370/2759] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:40.118635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:40.120325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:40.190126 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c229-8c45-4b1c-bee4-fea1e189f9a7 service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:40.194990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:40.195633 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:40.195917 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:40.196191 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:40.205068 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:40.206648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cf3fd-a1a1-4966-acff-fb2ce18317ae service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:40.214782 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1390/2760] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:09:41.048331 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:41.127177 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c04b5-497b-4454-9f46-a24d7e4fc0a6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:41.136248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:41.137708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:41.138216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:41.138803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] PATH_INFO: `/v3/users/70734ce1fede4313ba2cdd17dbd1519c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:41.140354 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70734ce1fede4313ba2cdd17dbd1519c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:41.144359 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:41.162979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:41.346539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70734ce1fede4313ba2cdd17dbd1519c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:41.347521 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70734ce1fede4313ba2cdd17dbd1519c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:41.348137 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70734ce1fede4313ba2cdd17dbd1519c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:41.356066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70734ce1fede4313ba2cdd17dbd1519c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:41.423805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70734ce1fede4313ba2cdd17dbd1519c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:41.450973 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:41.451558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:41.451558 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:41.453376 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1371/2761] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:41 2022] DELETE /identity/v3/users/70734ce1fede4313ba2cdd17dbd1519c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:41.471606 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:41.472881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:41.483779 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:41.538064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1391/2762] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:41.551517 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:41.553070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:41.626747 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046830-5c9c-40a9-b946-b74273a12c0f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:41.631211 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:41.632470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:41.632723 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:41.632932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:41.645661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:41.647333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:41.659970 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1372/2763] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:42.211017 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:42.212581 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:42.224941 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742b44-faa7-4258-a93b-ef2e7c83546c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:42.230233 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:42.231648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:42.232157 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:42.232647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] PATH_INFO: `/v3/projects/d29ab72deaaf4475bfaf22f31dd0fdd0` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:42.234136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29ab72deaaf4475bfaf22f31dd0fdd0)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:42.236925 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:42.416003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29ab72deaaf4475bfaf22f31dd0fdd0', 'request_id': 'req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.525857 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29ab72deaaf4475bfaf22f31dd0fdd0', 'request_id': 'req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.534314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29ab72deaaf4475bfaf22f31dd0fdd0', 'request_id': 'req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.551530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] The token cache is being invalidate because project d29ab72deaaf4475bfaf22f31dd0fdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:42.551853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.552597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.557787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1392/2764] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:42 2022] DELETE /identity/v3/projects/d29ab72deaaf4475bfaf22f31dd0fdd0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:42.559254 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:42.572197 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752fd8e-7d8b-4c5d-b0e7-2f19fe06325a service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:42.651538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:42.653216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:42.653758 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:42.654251 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] PATH_INFO: `/v3/users/14b6e4e4fcb54fe9ac95169fd420482c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:42.655838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b6e4e4fcb54fe9ac95169fd420482c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:42.659739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:42.865942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:42.879789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b6e4e4fcb54fe9ac95169fd420482c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.880476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b6e4e4fcb54fe9ac95169fd420482c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.881107 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b6e4e4fcb54fe9ac95169fd420482c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:42.889333 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b6e4e4fcb54fe9ac95169fd420482c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:43.371977 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-42242a6d-d888-4014-be86-6a389f8eec31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b6e4e4fcb54fe9ac95169fd420482c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:43.390292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1373/2765] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:42 2022] DELETE /identity/v3/users/14b6e4e4fcb54fe9ac95169fd420482c => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:43.929051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:43.929051 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:43.950486 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198badf-20f3-4aaf-ac8b-0cf4601e6f56 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.028059 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.028986 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.030018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.030311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] PATH_INFO: `/v3/projects/cd4c024f9a094aa1aa57f17afe665646` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.031537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4c024f9a094aa1aa57f17afe665646)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.033652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.140639 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:44.146801 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4c024f9a094aa1aa57f17afe665646', 'request_id': 'req-18cd8057-ac32-46c8-9c8e-d06fc74d328c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:44.223088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4c024f9a094aa1aa57f17afe665646', 'request_id': 'req-18cd8057-ac32-46c8-9c8e-d06fc74d328c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:44.230765 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4c024f9a094aa1aa57f17afe665646', 'request_id': 'req-18cd8057-ac32-46c8-9c8e-d06fc74d328c'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:44.245199 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] The token cache is being invalidate because project cd4c024f9a094aa1aa57f17afe665646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:44.245477 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:44.246287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-18cd8057-ac32-46c8-9c8e-d06fc74d328c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:44.248070 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1393/2766] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:43 2022] DELETE /identity/v3/projects/cd4c024f9a094aa1aa57f17afe665646 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:44.253690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.254196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.254452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.275610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:44.276988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:44.346241 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1374/2767] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:44.355223 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.355517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.355798 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.375320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:44.377299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:44.388761 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1394/2768] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:44.390047 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.402736 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073fb5f-aac6-451e-8cac-a2d2f2b03949 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.407653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.408334 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.408616 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.408923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.409661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:44.409965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.411614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.428079 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1375/2769] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:44.429196 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.440128 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12e1d1-892f-4312-8455-33cab27f7e06 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.446036 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.446911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.447377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.447659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.448496 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.450466 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.580430 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1395/2770] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:44 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:44.584564 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.597739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e5880-ee93-4ed7-93f9-ff7825df3cb7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.676661 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.677525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.677918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.678325 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.679141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.681171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.782838 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1376/2771] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:44 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:44.784260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.796363 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f20d8-2b04-4eed-bffa-71d6a0248e90 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.802702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.803851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.803851 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.804140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.804812 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.806421 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.825321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1396/2772] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:44.826866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.838416 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd988-81ff-4dcf-9500-72589fcec827 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.847017 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.847697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.847984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.848431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.849038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.850720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058a2f-3ea8-45c7-8f8f-ce5080d0a1bc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:44.868179 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1377/2773] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:44.872534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:44.892827 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f82a2-717c-453f-9863-5c0465ef830d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:44.898250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:44.899309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:44.899598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:44.899875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] PATH_INFO: `/v3/projects/330bbee66deb476b95e999f25e38c64e/users/3070dff93f324b40a288c0398ab9350d/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:44.922121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330bbee66deb476b95e999f25e38c64e, user_id=3070dff93f324b40a288c0398ab9350d, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:44.925469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.016834 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1397/2774] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:44 2022] PUT /identity/v3/projects/330bbee66deb476b95e999f25e38c64e/users/3070dff93f324b40a288c0398ab9350d/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:45.027497 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.038284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.038284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.064485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] MFA Rules not processed for user `3070dff93f324b40a288c0398ab9350d`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:45.066574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:45.072200 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:45.154715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1378/2775] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:45.160111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.245668 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fac5f-8589-4a9a-9d48-491fbd37f007 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.251312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.252269 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.252575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.252900 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.253648 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.255715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.345464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1398/2776] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:45 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:45.346956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.360938 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2174a1-8bfe-46a2-8abe-3666ecae5378 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.443257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.443860 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.444146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.444428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.446613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.447269 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.530875 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1379/2777] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:45 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:45.533021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.545237 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0bfb-1740-46cb-b9ff-394707d9198a admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.550542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.551219 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.551522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.551783 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.552565 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.554229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.567777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1399/2778] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:45.580915 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.596280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4e4c8-cc41-4e21-9846-12dd7ba3988f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.601897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.602812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.603085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.603362 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] PATH_INFO: `/v3/projects/846180ca1441420d89e3f57b25a4a71d/users/0eeb9889d29a4a5f9ae5cb17e2e61494/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.630582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=846180ca1441420d89e3f57b25a4a71d, user_id=0eeb9889d29a4a5f9ae5cb17e2e61494, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.633288 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.744337 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1380/2779] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:45 2022] PUT /identity/v3/projects/846180ca1441420d89e3f57b25a4a71d/users/0eeb9889d29a4a5f9ae5cb17e2e61494/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:45.748591 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.760089 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337538-1bef-483f-9eda-79099ce92144 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.803846 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:45.822950 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.823634 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.828109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.828109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.828109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.828109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09137ad4-ced5-4592-8dc0-6ef1cb5fb9c7 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.841735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1400/2780] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:45.843174 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:45.858159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96371d-9ad1-46ea-b7f7-9d8cdc711bff admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:45.863411 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:45.864314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.864597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.864944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] PATH_INFO: `/v3/projects/846180ca1441420d89e3f57b25a4a71d/users/0eeb9889d29a4a5f9ae5cb17e2e61494/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.866959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] RBAC: Authorizing `identity:create_grant(project_id=846180ca1441420d89e3f57b25a4a71d, user_id=0eeb9889d29a4a5f9ae5cb17e2e61494, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:45.869636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:45.883840 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1381/2781] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:45 2022] PUT /identity/v3/projects/846180ca1441420d89e3f57b25a4a71d/users/0eeb9889d29a4a5f9ae5cb17e2e61494/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:45.895820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:45.896113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:45.896391 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:45.928787 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] MFA Rules not processed for user `0eeb9889d29a4a5f9ae5cb17e2e61494`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:45.930039 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:46.024206 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1401/2782] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:46.032914 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:46.034728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:46.107693 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe0087-c4e6-45d2-8a37-82898c9870af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:46.112195 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:46.112878 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:46.113184 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:46.113479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:46.123897 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:46.126091 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:46.131323 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:46.136471 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1382/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:09:46.582810 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:46.596117 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302d22-a177-41c7-8370-eff3c5ea4499 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:46.600628 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:46.601384 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:46.601677 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:46.601953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:46.674494 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:46.675939 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89bc2-621e-4dfa-8b96-e525832cff0b service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:46.685569 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1402/2784] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:50.587026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:50.656982 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44554f-1237-4e11-a2c1-3bab31995a35 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:50.667266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:50.667266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:50.667266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:50.667266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] PATH_INFO: `/v3/users/3070dff93f324b40a288c0398ab9350d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:50.667695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3070dff93f324b40a288c0398ab9350d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:50.667695 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:50.885145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3070dff93f324b40a288c0398ab9350d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:50.885830 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3070dff93f324b40a288c0398ab9350d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:50.886554 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3070dff93f324b40a288c0398ab9350d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:50.894109 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3070dff93f324b40a288c0398ab9350d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:50.937083 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3070dff93f324b40a288c0398ab9350d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:50.958916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1383/2785] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:50 2022] DELETE /identity/v3/users/3070dff93f324b40a288c0398ab9350d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:50.963600 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154da2-b38e-4601-892a-808be3402040 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:50.964104 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154da2-b38e-4601-892a-808be3402040 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:50.964212 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154da2-b38e-4601-892a-808be3402040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:50.983943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-9f154da2-b38e-4601-892a-808be3402040 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:50.985754 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9f154da2-b38e-4601-892a-808be3402040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:51.050926 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:51.060331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1403/2786] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:09:51.071809 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:51.073425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:51.139038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585dce-7edf-47ec-8f22-7a98bd83dd55 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:51.143238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:51.143905 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:51.144189 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:51.144468 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:51.155979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:51.157205 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:51.171619 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1384/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:51.623153 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154da2-b38e-4601-892a-808be3402040 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:51.624584 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-9f154da2-b38e-4601-892a-808be3402040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:51.644437 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154da2-b38e-4601-892a-808be3402040 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:51.650125 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:51.651020 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:51.651309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:51.651881 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] PATH_INFO: `/v3/projects/330bbee66deb476b95e999f25e38c64e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:51.653410 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330bbee66deb476b95e999f25e38c64e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:51.656200 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:51.792647 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330bbee66deb476b95e999f25e38c64e', 'request_id': 'req-e560a533-f56d-43c7-97db-0cd5f8921629'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:51.867306 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330bbee66deb476b95e999f25e38c64e', 'request_id': 'req-e560a533-f56d-43c7-97db-0cd5f8921629'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:51.876775 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330bbee66deb476b95e999f25e38c64e', 'request_id': 'req-e560a533-f56d-43c7-97db-0cd5f8921629'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:51.889831 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] The token cache is being invalidate because project 330bbee66deb476b95e999f25e38c64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:51.890187 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:51.890883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:51.895609 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1404/2788] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:51 2022] DELETE /identity/v3/projects/330bbee66deb476b95e999f25e38c64e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:51.897196 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:51.909259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48989a-1a1c-4ac3-8e50-d48c843f5b11 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:51.929871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:51.982535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:51.983792 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:51.984076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:51.984349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] PATH_INFO: `/v3/users/0eeb9889d29a4a5f9ae5cb17e2e61494` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:51.985922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eeb9889d29a4a5f9ae5cb17e2e61494)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:51.987978 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:52.210582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eeb9889d29a4a5f9ae5cb17e2e61494'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:52.211281 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eeb9889d29a4a5f9ae5cb17e2e61494'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:52.211896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eeb9889d29a4a5f9ae5cb17e2e61494'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:52.222446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eeb9889d29a4a5f9ae5cb17e2e61494'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:52.319920 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0edebddc-e2e9-4397-acd7-ed1b19da4808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eeb9889d29a4a5f9ae5cb17e2e61494'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:52.340228 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1385/2789] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:51 2022] DELETE /identity/v3/users/0eeb9889d29a4a5f9ae5cb17e2e61494 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:53.075218 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:53.077150 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:53.099179 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a533-f56d-43c7-97db-0cd5f8921629 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:53.166575 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:53.167464 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.167814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.168062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] PATH_INFO: `/v3/projects/846180ca1441420d89e3f57b25a4a71d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.169279 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] RBAC: Authorizing `identity:delete_project(project_id=846180ca1441420d89e3f57b25a4a71d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:53.171193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:53.343292 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846180ca1441420d89e3f57b25a4a71d', 'request_id': 'req-d629e52f-8f22-4dd3-ba42-2adb152f499a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:53.449923 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846180ca1441420d89e3f57b25a4a71d', 'request_id': 'req-d629e52f-8f22-4dd3-ba42-2adb152f499a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:53.458229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846180ca1441420d89e3f57b25a4a71d', 'request_id': 'req-d629e52f-8f22-4dd3-ba42-2adb152f499a'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:53.471909 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] The token cache is being invalidate because project 846180ca1441420d89e3f57b25a4a71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:53.472198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:53.472880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-d629e52f-8f22-4dd3-ba42-2adb152f499a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:53.474690 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1405/2790] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:53 2022] DELETE /identity/v3/projects/846180ca1441420d89e3f57b25a4a71d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:53.479396 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.479887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.479998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.498760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:53.501006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:53.571264 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1386/2791] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:53.579042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.579312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.579707 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.599526 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:53.600784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:53.611674 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1406/2792] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:53.616021 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:53.626318 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585571d-10a2-4e9f-830d-81f48412f859 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:53.631403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:53.632538 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.632988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.633275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.635116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:53.635116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:53.643765 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:53.652436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1387/2793] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:09:53.653619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:53.664338 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e4aa-c5ee-4f71-95d2-e3f821a1275e None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:53.669729 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:53.670405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.670743 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.670972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.671663 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:53.673735 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:53.677727 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:53.897470 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1407/2794] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:53.901807 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:53.913590 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cea8-1171-4d0a-8fad-704ef21ebd89 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:53.948018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:53.990156 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:53.991142 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:53.991487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:53.991900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:53.993879 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:53.996961 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.092308 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1388/2795] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:53 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:54.096817 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.109873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b0c00-13d3-4519-a31a-d264685f0dd2 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.115127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.115820 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.116082 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.116360 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.117327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.120604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.142635 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1408/2796] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:54.143837 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.156369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5902919-399e-4d4c-b395-7492445a43ad admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.164450 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.165185 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.165542 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.165827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.166613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.168387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5001-5c1b-4942-911b-f825e7b743ee admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.184038 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1389/2797] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:54.185598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.201692 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bcbf-1a24-469c-b7e6-04b6bc2b5862 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.208180 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.209123 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.209480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.209776 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] PATH_INFO: `/v3/projects/92ec173ba1c54f9fafbe5b09d3786087/users/ccb29f5c0d724e34b437c4f47dd8a997/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.232340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ec173ba1c54f9fafbe5b09d3786087, user_id=ccb29f5c0d724e34b437c4f47dd8a997, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.236252 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.308302 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1409/2798] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:54 2022] PUT /identity/v3/projects/92ec173ba1c54f9fafbe5b09d3786087/users/ccb29f5c0d724e34b437c4f47dd8a997/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:54.379248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.379717 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.380102 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.413714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] MFA Rules not processed for user `ccb29f5c0d724e34b437c4f47dd8a997`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:54.414846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:54.505155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1390/2799] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:54.509799 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.595108 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189cfab-dfca-4c67-a6e8-a74095ca527e admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.600083 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.600960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.601331 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.601689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.602627 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.604459 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.763203 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1410/2800] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:54 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:54.764610 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.778217 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c808-7422-4df8-a4e7-31280d876a35 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.850700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.851567 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.851976 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.852385 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.853283 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.855614 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.941239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1391/2801] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:54 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:54.943170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:54.958248 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4721-da5d-48c3-b7f6-d26ae89aa8dc admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:54.964550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:54.965449 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:54.965737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:54.966166 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:54.967124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:54.969622 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:54.990545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1411/2802] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:54.991933 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:55.005895 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12c04-124c-4d31-96b9-6e380db82696 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:55.021297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:55.021297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.021297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.021297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] PATH_INFO: `/v3/projects/aeeba0634cfc4511b1945f64cca29162/users/94668a33244a4af0bf6a98527de52640/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.045623 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeba0634cfc4511b1945f64cca29162, user_id=94668a33244a4af0bf6a98527de52640, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:55.049728 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:55.152769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1392/2803] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:54 2022] PUT /identity/v3/projects/aeeba0634cfc4511b1945f64cca29162/users/94668a33244a4af0bf6a98527de52640/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:55.154683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:55.167549 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d8d5-f93a-48e6-b14a-5210ffdc9fc6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:55.247382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:55.247382 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.247745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.247745 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.248474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:55.250858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbaa28-8ee6-4219-af82-5f53c5d3e2ed admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:55.263762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1412/2804] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:55.266344 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:55.272223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:55.277712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f34-de3b-4b74-b7b3-803156750698 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:55.283292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:55.288400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.288400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.288400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] PATH_INFO: `/v3/projects/aeeba0634cfc4511b1945f64cca29162/users/94668a33244a4af0bf6a98527de52640/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.288400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeba0634cfc4511b1945f64cca29162, user_id=94668a33244a4af0bf6a98527de52640, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:55.289527 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:55.301932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1393/2805] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:55 2022] PUT /identity/v3/projects/aeeba0634cfc4511b1945f64cca29162/users/94668a33244a4af0bf6a98527de52640/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:55.313514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.314057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.314417 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.345722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] MFA Rules not processed for user `94668a33244a4af0bf6a98527de52640`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:55.347296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:55.356872 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:55.425608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1413/2806] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:55.437530 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:55.439677 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:55.501420 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250875e-f16d-4212-a908-c770ae25b227 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:55.504834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:55.505491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.506058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.506146 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.519998 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:55.523085 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ffc12-2ee0-4fc9-bec2-601c8a68e4ef service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:55.543340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1394/2807] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:55.617792 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:55.681321 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806541dc-976c-427a-a0be-eb9457c9fda5 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:55.685929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:55.686805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:55.687088 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:55.687399 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] PATH_INFO: `/v3/users/ccb29f5c0d724e34b437c4f47dd8a997` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:55.688958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb29f5c0d724e34b437c4f47dd8a997)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:55.690901 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:55.940892 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb29f5c0d724e34b437c4f47dd8a997'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:55.948061 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb29f5c0d724e34b437c4f47dd8a997'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:55.948793 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb29f5c0d724e34b437c4f47dd8a997'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:55.949411 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb29f5c0d724e34b437c4f47dd8a997'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.034353 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb29f5c0d724e34b437c4f47dd8a997'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.058387 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1414/2808] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:55 2022] DELETE /identity/v3/users/ccb29f5c0d724e34b437c4f47dd8a997 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:56.060425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:56.060749 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:56.061031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:56.080150 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:56.081442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:56.146193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1395/2809] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:56.156561 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:56.158290 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:56.190343 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:56.224298 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eedc4-bc1e-4ba7-8e93-ffbcd9604089 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:56.228683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:56.229413 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:56.229666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:56.229968 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:56.240519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:56.242247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:56.255868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1415/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:56.748500 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:56.750516 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:56.762808 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2590-63cf-4225-ae7f-1d3f753018f5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:56.768001 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:56.768935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:56.769222 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:56.769501 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] PATH_INFO: `/v3/projects/92ec173ba1c54f9fafbe5b09d3786087` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:56.770700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ec173ba1c54f9fafbe5b09d3786087)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:56.772704 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:56.884544 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ec173ba1c54f9fafbe5b09d3786087', 'request_id': 'req-eb1c846e-1457-4e8b-b508-be36c8846d11'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.965489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ec173ba1c54f9fafbe5b09d3786087', 'request_id': 'req-eb1c846e-1457-4e8b-b508-be36c8846d11'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.972973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ec173ba1c54f9fafbe5b09d3786087', 'request_id': 'req-eb1c846e-1457-4e8b-b508-be36c8846d11'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.983963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] The token cache is being invalidate because project 92ec173ba1c54f9fafbe5b09d3786087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:56.984896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.985687 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eb1c846e-1457-4e8b-b508-be36c8846d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:56.987353 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1396/2811] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:56 2022] DELETE /identity/v3/projects/92ec173ba1c54f9fafbe5b09d3786087 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:56.991520 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:57.002143 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ec6c-0a3e-4b19-9fa4-dfce3a09c3fb service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:57.059173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:57.060050 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:57.060333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:57.060610 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] PATH_INFO: `/v3/users/94668a33244a4af0bf6a98527de52640` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:57.061823 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94668a33244a4af0bf6a98527de52640)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:57.064072 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:57.242211 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94668a33244a4af0bf6a98527de52640'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:57.249346 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94668a33244a4af0bf6a98527de52640'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:57.250076 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94668a33244a4af0bf6a98527de52640'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:57.250750 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94668a33244a4af0bf6a98527de52640'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:57.359505 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94668a33244a4af0bf6a98527de52640'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:57.378722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1416/2812] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:56 2022] DELETE /identity/v3/users/94668a33244a4af0bf6a98527de52640 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:57.438700 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:57.439062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:57.439406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:57.458130 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:57.459444 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:57.469886 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:57.516013 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1397/2813] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:09:57.528127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:57.529599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:57.581424 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:57.603113 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203adcb-cbd8-4afa-996a-822358a8f138 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:57.608805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:57.612945 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:57.613866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:57.613866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:57.623657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:57.625982 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e800d1-ca19-4704-bd09-9af83f69263c service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:57.634875 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1417/2814] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:09:57.891686 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:57.907149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:57.960339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a3e8-2ec1-45fd-9f6b-c4a60571a46f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:57.964874 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:57.965740 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:57.966026 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:57.966303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] PATH_INFO: `/v3/projects/aeeba0634cfc4511b1945f64cca29162` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:57.967827 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeeba0634cfc4511b1945f64cca29162)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:57.969815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.109609 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeeba0634cfc4511b1945f64cca29162', 'request_id': 'req-e25b16e7-a030-4d95-85c4-d426d7bea207'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:58.193790 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeeba0634cfc4511b1945f64cca29162', 'request_id': 'req-e25b16e7-a030-4d95-85c4-d426d7bea207'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:58.200660 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeeba0634cfc4511b1945f64cca29162', 'request_id': 'req-e25b16e7-a030-4d95-85c4-d426d7bea207'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:58.211193 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] The token cache is being invalidate because project aeeba0634cfc4511b1945f64cca29162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:58.211491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:58.212117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e25b16e7-a030-4d95-85c4-d426d7bea207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:58.213726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1398/2815] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:57 2022] DELETE /identity/v3/projects/aeeba0634cfc4511b1945f64cca29162 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:58.218640 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.218977 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.219340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.237858 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:58.239127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:58.299063 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1418/2816] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:58.307009 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.307294 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.307573 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.326839 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:58.328092 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:58.336248 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1399/2817] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:58.340718 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.350958 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb38fd-0c56-4854-a794-3e54df5924a1 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.355720 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.356376 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.356657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.356961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.357689 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:58.357995 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.360311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.372025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1419/2818] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:58.377145 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.386433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040f41a-c93a-4380-bba5-53eb2286e5fc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.391206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.391866 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.392171 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.392445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.393168 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.395099 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.539507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1400/2819] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:58 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:58.543432 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.554595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935fc4-d566-4e6a-9411-f55ccdb125c9 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.613062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.613672 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.613963 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.614245 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.614949 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.616961 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.714348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1420/2820] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:58 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:58.718349 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.729602 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7db9-ee99-4d34-ba9f-9d83a1107e77 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.735580 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.742940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.742940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.742940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.742940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.742940 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.750834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1401/2821] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:58.754763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.764825 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9c81-12b0-45c3-8e51-b1355c69b5c6 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.770504 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.771164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.771522 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.771888 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.772611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.774214 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e76f7-8a4f-4d8c-bc80-786140a212fb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.785532 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1421/2822] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:58.789462 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:58.799868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f789385-2cee-4f3f-bd9a-9fbf2cd48dc3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:58.804653 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:58.805570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.805857 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.806138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] PATH_INFO: `/v3/projects/6166f4e8f49845b5a6555d09f35c278d/users/87bc01563b0a4613ae1f29a692e580ec/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.814296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:58.821407 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6166f4e8f49845b5a6555d09f35c278d, user_id=87bc01563b0a4613ae1f29a692e580ec, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:58.838004 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:58.926778 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1402/2823] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:58 2022] PUT /identity/v3/projects/6166f4e8f49845b5a6555d09f35c278d/users/87bc01563b0a4613ae1f29a692e580ec/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:58.940177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:58.940497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:58.940762 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:58.967889 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] MFA Rules not processed for user `87bc01563b0a4613ae1f29a692e580ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:58.969868 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:58.999876 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:59.037953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1422/2824] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:59.042442 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.104328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489138e5-3039-49bc-add3-2f07f09976e8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.109120 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.110117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.110409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.110692 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.111400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.113374 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.247423 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1403/2825] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:59 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:59.251460 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.262002 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ee3f-6a23-447b-9721-a7a4441ab377 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.318936 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.319632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.319883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.320162 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.320880 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.322800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.387983 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1423/2826] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:59 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:59.392346 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.402752 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee302-95d7-45ae-9b33-1268c97650af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.407972 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.408640 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.408958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.409234 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.409973 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.411570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.422979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1404/2827] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:59.427253 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.437386 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145202-9360-4392-b66b-5fc7eeaae336 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.442013 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.445037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.445037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.445037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] PATH_INFO: `/v3/projects/641386eeb8474e65b131b41bc97c8f8a/users/642622bc4a4242c8ac327e128438bd54/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.458715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641386eeb8474e65b131b41bc97c8f8a, user_id=642622bc4a4242c8ac327e128438bd54, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.461451 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.559333 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1424/2828] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:59 2022] PUT /identity/v3/projects/641386eeb8474e65b131b41bc97c8f8a/users/642622bc4a4242c8ac327e128438bd54/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:59.563284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.573304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e8de-c489-40c8-8aab-f7fc1911223e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.631117 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.631794 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.632106 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.632389 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.633157 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.634761 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757fa43-a653-4612-9848-904f83a2bf26 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.645366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1405/2829] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:59.649474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.663555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aed49-aa99-4de2-a80c-6211a6f73449 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.669170 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.670254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.670545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.670824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] PATH_INFO: `/v3/projects/641386eeb8474e65b131b41bc97c8f8a/users/642622bc4a4242c8ac327e128438bd54/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.672969 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641386eeb8474e65b131b41bc97c8f8a, user_id=642622bc4a4242c8ac327e128438bd54, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.675920 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.686394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1425/2830] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:59 2022] PUT /identity/v3/projects/641386eeb8474e65b131b41bc97c8f8a/users/642622bc4a4242c8ac327e128438bd54/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:59.699118 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.699419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.699735 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.727511 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] MFA Rules not processed for user `642622bc4a4242c8ac327e128438bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:59.728773 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:59.772470 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:59.796206 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1406/2831] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:59.807645 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:59.809389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:59.865597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd3ec5-b379-4998-ae3b-16969af72a97 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:59.869258 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:59.869913 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:59.870455 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:59.870736 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:59.880288 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:59.881760 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:59.892003 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1426/2832] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:59.994803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:00.005515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412afb-a330-4a82-a325-a908771aa894 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:00.009175 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:00.009829 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:00.010115 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:00.010395 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:00.066159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:00.067593 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:00.076357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1407/2833] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:00.905595 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:00.913345 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:00.949242 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:00.985124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fbae6-a8f2-43a9-b41b-bb0a5e7887ce service cinder] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:00.989811 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:00.990737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:00.991723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:00.991723 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] PATH_INFO: `/v3/users/300c7b2a849e4fc8a39bdab8564b5291` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:00.992509 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300c7b2a849e4fc8a39bdab8564b5291)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:00.994837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:01.181048 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300c7b2a849e4fc8a39bdab8564b5291'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.187853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300c7b2a849e4fc8a39bdab8564b5291'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.188497 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300c7b2a849e4fc8a39bdab8564b5291'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.189130 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300c7b2a849e4fc8a39bdab8564b5291'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.274062 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-ae60498c-2d18-42a5-881c-eaa56527cc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300c7b2a849e4fc8a39bdab8564b5291'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.292715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1427/2834] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:00 2022] DELETE /identity/v3/users/300c7b2a849e4fc8a39bdab8564b5291 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:01.567877 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:01.579769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d84d0-253b-4c3c-bcf7-e9a2dcc5b1cf service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:01.641063 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:01.642664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:01.642959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:01.643245 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] PATH_INFO: `/v3/projects/ba9a225950ec47069abf0f51e8ff7a05` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:01.644456 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9a225950ec47069abf0f51e8ff7a05)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:01.646402 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:01.754720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9a225950ec47069abf0f51e8ff7a05', 'request_id': 'req-62b4f7cd-903a-44ff-a092-da37fc2277ec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.828116 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9a225950ec47069abf0f51e8ff7a05', 'request_id': 'req-62b4f7cd-903a-44ff-a092-da37fc2277ec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.835834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9a225950ec47069abf0f51e8ff7a05', 'request_id': 'req-62b4f7cd-903a-44ff-a092-da37fc2277ec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.846428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] The token cache is being invalidate because project ba9a225950ec47069abf0f51e8ff7a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:01.846714 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.847368 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-62b4f7cd-903a-44ff-a092-da37fc2277ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:01.849126 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1408/2835] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:01 2022] DELETE /identity/v3/projects/ba9a225950ec47069abf0f51e8ff7a05 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:01.853964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:01.854260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:01.854542 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:01.872773 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:01.873978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:01.934115 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1428/2836] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:01.942922 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:01.943215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:01.943499 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:01.963138 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:01.964338 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:01.973708 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1409/2837] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:01.976976 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:01.987243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a95fd-c8ab-4e11-ab29-0476770397fb None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:01.992164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:01.993035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:01.993327 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:01.993607 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:01.997619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:10:01.997619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:01.997619 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.013741 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1429/2838] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:10:02.015181 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.022577 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:02.026999 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7add-b39b-44dd-94c5-7d0c7aefb0f5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.031699 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.032613 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.032856 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.033161 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.033923 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.035804 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.144341 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1410/2839] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:10:02 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:10:02.147348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.158586 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf0539-2c67-49e8-b593-6cac77a58481 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.188618 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:02.213572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.214244 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.214530 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.214808 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.215491 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.217514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.341079 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1430/2840] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:10:02 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:02.345599 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.355985 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a96a-ac76-41c0-a70e-7780c61d8124 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.361345 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.362003 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.362280 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.362548 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.363296 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.364986 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.375529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1411/2841] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:02.379855 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.393194 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4695459-67f0-4ef6-98dc-494a47aff3ed admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.398075 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.398830 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.399033 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.399320 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.400049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.402552 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b7cd-5c31-4320-98f0-5639b6adca82 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.417525 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1431/2842] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:02.418523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.429498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097af6-446b-4a3e-8954-03990259f11e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.435869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.435869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.435869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.435869 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] PATH_INFO: `/v3/projects/0950170c6a98448db5f7dfc887b5186d/users/2d3e3e3beabf42ff9aae385a20dbf7eb/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.450307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0950170c6a98448db5f7dfc887b5186d, user_id=2d3e3e3beabf42ff9aae385a20dbf7eb, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.452964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.536018 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1412/2843] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:10:02 2022] PUT /identity/v3/projects/0950170c6a98448db5f7dfc887b5186d/users/2d3e3e3beabf42ff9aae385a20dbf7eb/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:02.546994 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.547280 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.547592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.574330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] MFA Rules not processed for user `2d3e3e3beabf42ff9aae385a20dbf7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:02.575538 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:02.642906 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1432/2844] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:02.654559 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:02.656409 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:02.713720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12a2e5-8387-4d47-bf5f-fbfca2cfc7e6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:02.717556 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387a99329ad748118d233f4a2c644c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:02.718297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:02.718566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:02.718845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:02.727845 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:02.732464 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd0f86-2763-4f41-a3b9-4d89565acca0 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:02.738267 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1413/2845] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:03.468018 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:03.469440 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:03.536348 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac93a2-2813-4af4-b407-d6e12b264532 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:03.540824 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:03.541704 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:03.541985 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:03.542260 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] PATH_INFO: `/v3/users/87bc01563b0a4613ae1f29a692e580ec` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:03.543441 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bc01563b0a4613ae1f29a692e580ec)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:03.545379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:03.764996 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:03.767572 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bc01563b0a4613ae1f29a692e580ec'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:03.774911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bc01563b0a4613ae1f29a692e580ec'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:03.775623 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bc01563b0a4613ae1f29a692e580ec'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:03.776243 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bc01563b0a4613ae1f29a692e580ec'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:03.873513 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bc01563b0a4613ae1f29a692e580ec'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:03.891330 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1433/2846] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:03 2022] DELETE /identity/v3/users/87bc01563b0a4613ae1f29a692e580ec => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:03.900871 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:03.901803 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:03.901989 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:03.919364 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:03.920588 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:03.979964 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1414/2847] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:10:03.989582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:03.991030 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:04.055871 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2c5-9a2d-41a8-b891-7669497d8e73 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:04.060031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:04.060797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:04.061164 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:04.061508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:04.073652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:04.075188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:04.089177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1434/2848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:04.499854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:04.501715 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:04.519484 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b4f02-2397-4122-8063-11ccfd8bd066 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:04.521369 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:04.522275 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:04.522551 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:04.522834 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] PATH_INFO: `/v3/projects/6166f4e8f49845b5a6555d09f35c278d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:04.524024 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6166f4e8f49845b5a6555d09f35c278d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:04.526378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:04.658314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:04.662383 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6166f4e8f49845b5a6555d09f35c278d', 'request_id': 'req-fd9c188f-6c75-4238-bde7-44f6af2a8899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:04.742543 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6166f4e8f49845b5a6555d09f35c278d', 'request_id': 'req-fd9c188f-6c75-4238-bde7-44f6af2a8899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:04.750618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6166f4e8f49845b5a6555d09f35c278d', 'request_id': 'req-fd9c188f-6c75-4238-bde7-44f6af2a8899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:04.762436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] The token cache is being invalidate because project 6166f4e8f49845b5a6555d09f35c278d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:04.762726 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:04.763428 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:04.765030 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1415/2849] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:04 2022] DELETE /identity/v3/projects/6166f4e8f49845b5a6555d09f35c278d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:04.769262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:04.779585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9014-3c97-454e-af2d-9009eeb6c1de service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:04.837511 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:04.838402 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:04.838684 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:04.838960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] PATH_INFO: `/v3/users/642622bc4a4242c8ac327e128438bd54` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:04.840147 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] RBAC: Authorizing `identity:delete_user(user_id=642622bc4a4242c8ac327e128438bd54)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:04.842101 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:05.045960 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642622bc4a4242c8ac327e128438bd54'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.054517 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642622bc4a4242c8ac327e128438bd54'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.055241 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642622bc4a4242c8ac327e128438bd54'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.055849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642622bc4a4242c8ac327e128438bd54'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.142234 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2a617aaa-8d57-4a5f-9923-445dbdf4631f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642622bc4a4242c8ac327e128438bd54'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.144660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:05.160800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1435/2850] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:04 2022] DELETE /identity/v3/users/642622bc4a4242c8ac327e128438bd54 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:10:05.618479 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:05.622641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:05.633918 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c188f-6c75-4238-bde7-44f6af2a8899 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:05.694690 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:05.695566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:05.700259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:05.700259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] PATH_INFO: `/v3/projects/641386eeb8474e65b131b41bc97c8f8a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:05.700259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641386eeb8474e65b131b41bc97c8f8a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:05.700259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:05.817652 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641386eeb8474e65b131b41bc97c8f8a', 'request_id': 'req-85771b9e-f19d-4d9e-9471-698baa255b06'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.929358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641386eeb8474e65b131b41bc97c8f8a', 'request_id': 'req-85771b9e-f19d-4d9e-9471-698baa255b06'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.936481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641386eeb8474e65b131b41bc97c8f8a', 'request_id': 'req-85771b9e-f19d-4d9e-9471-698baa255b06'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.948292 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] The token cache is being invalidate because project 641386eeb8474e65b131b41bc97c8f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:05.948581 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.949270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85771b9e-f19d-4d9e-9471-698baa255b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:05.950818 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1416/2851] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:05 2022] DELETE /identity/v3/projects/641386eeb8474e65b131b41bc97c8f8a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:05.956662 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:05.957189 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:05.957463 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:05.975789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:05.977069 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:06.039335 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1436/2852] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:06.047380 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.047671 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.047956 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.066873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:06.068086 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:06.077065 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1417/2853] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:06.082127 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.091894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eef2e6-68d7-4840-9764-2f8301a078f2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.096537 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.097232 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.097519 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.097795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.098528 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:10:06.098838 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.100436 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.112192 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1437/2854] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:10:06.116555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.126360 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cbee7-25db-440a-b8a8-32777cb3d588 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.132438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.133155 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.133443 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.133719 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.134445 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.136357 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.228284 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1418/2855] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:10:06 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:06.232483 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.243763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676963ba-8fc7-4f23-80c2-391fba72187f admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.303597 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.304287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.304576 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.304886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.305604 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.307636 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.422544 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1438/2856] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:10:06 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:06.427403 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.443262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0e58-44a0-4bc9-90f9-9b77cd8bb940 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.447887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.448555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.448887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.449166 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.449896 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.451489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.462525 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1419/2857] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:06.466543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.477592 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0987-3b5f-4494-816c-ea95fe00c0bd admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.482195 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.482797 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.483090 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.483362 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.484124 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.485748 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61495e-3a58-4f49-b511-25799437d052 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.497508 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1439/2858] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:06.501763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.512528 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db62-e4be-4e45-8f67-c36511c8468c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.517769 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.518733 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.519016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.519290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] PATH_INFO: `/v3/projects/5dfff20955284dd7bd2c012e5079798f/users/997acb02a3454b2b928dd66f831b4a52/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.534290 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfff20955284dd7bd2c012e5079798f, user_id=997acb02a3454b2b928dd66f831b4a52, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.537149 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.601343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:06.606250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1420/2859] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:10:06 2022] PUT /identity/v3/projects/5dfff20955284dd7bd2c012e5079798f/users/997acb02a3454b2b928dd66f831b4a52/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:06.612080 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128076-14ca-40ba-b076-6e19b2b6bd8f None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.612394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128076-14ca-40ba-b076-6e19b2b6bd8f None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.612697 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91128076-14ca-40ba-b076-6e19b2b6bd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.631529 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-91128076-14ca-40ba-b076-6e19b2b6bd8f None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:06.634022 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-91128076-14ca-40ba-b076-6e19b2b6bd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:06.680730 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:06.695814 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1440/2860] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:06.705431 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:06.707304 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:06.768067 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d26d-2fab-4376-a3dd-8b14c2816146 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:06.772012 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:06.772664 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:06.772979 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:06.773491 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:06.784887 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:06.786148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:06.796259 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1421/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:08.099085 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.099613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.099714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.128972 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] MFA Rules not processed for user `997acb02a3454b2b928dd66f831b4a52`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:08.130222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:08.200087 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1441/2862] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:08.204632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.215371 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024cc2c-0d56-46fb-8b11-a0e2f882c378 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.222557 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.223236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.223523 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.223802 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.224515 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.226487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.309755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1422/2863] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:08.313660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.325370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b676-665e-41a1-8eca-4dc712cc7ee2 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.384951 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.385568 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.385866 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.386173 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.386896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.389057 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.497734 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1442/2864] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:10:08 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:08.502438 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.514033 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df3058-cb12-45d2-a033-9812fa4ac72c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.519170 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.519945 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.520404 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.520822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.521669 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.523299 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.536400 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1423/2865] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:08.540311 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.551853 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc07a9-ef6f-498e-bc57-2ad3df18ffbe admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.556837 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.557746 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.558035 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.558303 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] PATH_INFO: `/v3/projects/895f9fca68fd49d3aba3edb6fc74d198/users/5e6d02bfbea54a36af2390f87aaa168e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.574643 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f9fca68fd49d3aba3edb6fc74d198, user_id=5e6d02bfbea54a36af2390f87aaa168e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.577310 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.646605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1443/2866] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:10:08 2022] PUT /identity/v3/projects/895f9fca68fd49d3aba3edb6fc74d198/users/5e6d02bfbea54a36af2390f87aaa168e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:08.650572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.661406 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b97e6-412a-4a69-9391-0489b7c42853 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.720089 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.720850 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.721191 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.721476 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.722437 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.724049 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855716b-adc1-4531-9c7f-d2bbe6eb8e57 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.734356 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1424/2867] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:08.739309 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:08.750334 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542bb5b-3166-4843-b9e4-7091defe0c43 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:08.756354 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:08.757299 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:08.757580 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:08.757849 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] PATH_INFO: `/v3/projects/895f9fca68fd49d3aba3edb6fc74d198/users/5e6d02bfbea54a36af2390f87aaa168e/roles/ebbfe49b13964adab174b6721d50a779` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:08.759943 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f9fca68fd49d3aba3edb6fc74d198, user_id=5e6d02bfbea54a36af2390f87aaa168e, role_id=ebbfe49b13964adab174b6721d50a779)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:08.762665 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab64a8-a999-4f9a-8bb0-fbe1b3c5cd7c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:08.773553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1444/2868] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:10:08 2022] PUT /identity/v3/projects/895f9fca68fd49d3aba3edb6fc74d198/users/5e6d02bfbea54a36af2390f87aaa168e/roles/ebbfe49b13964adab174b6721d50a779 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:10.126991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:10.127447 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:10.127545 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:10.158076 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] MFA Rules not processed for user `5e6d02bfbea54a36af2390f87aaa168e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:10.159302 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:10.216822 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:10.235570 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1425/2869] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:10.247611 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:10.248246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:10.248246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:10.269314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] MFA Rules not processed for user `997acb02a3454b2b928dd66f831b4a52`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:10.269314 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:10.294686 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:10.326293 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1445/2870] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:10.339656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:10.340904 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:10.416688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdddad7-2993-4267-931a-60d53e261008 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:10.422480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80112c46-a365-4824-9781-d18162292be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90b3884fbabf435dab3e9a017e9d2379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:10.423148 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80112c46-a365-4824-9781-d18162292be0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:10.423436 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80112c46-a365-4824-9781-d18162292be0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:10.423718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80112c46-a365-4824-9781-d18162292be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:10.432885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80112c46-a365-4824-9781-d18162292be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:10.434487 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80112c46-a365-4824-9781-d18162292be0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:10.443691 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1426/2871] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:10.680227 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:10.735426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce3727-9844-45da-97d4-5a0521c64ce3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:10.739254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:10.739907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:10.740193 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:10.740472 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:10.742275 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:10.752394 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:10.753991 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:10.762465 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1446/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:20.439370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=38 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:20.758514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=37 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:28.746816 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80112c46-a365-4824-9781-d18162292be0 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:28.748268 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80112c46-a365-4824-9781-d18162292be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:28.804705 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80112c46-a365-4824-9781-d18162292be0 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:28.810767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:28.810767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:28.810767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:28.810767 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:28.819272 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:28.820634 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e49d5-a7f8-4934-bd97-ceae81054f8f service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:28.830319 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1427/2873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:36.010021 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:36.011605 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:36.077498 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb5f-4ebb-41ab-bb98-331b8e190c8b service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:36.081974 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:36.082843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:36.084146 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:36.084423 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] PATH_INFO: `/v3/users/2d3e3e3beabf42ff9aae385a20dbf7eb` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:36.085658 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3e3e3beabf42ff9aae385a20dbf7eb)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:36.087589 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:36.281165 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3e3e3beabf42ff9aae385a20dbf7eb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:36.288873 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3e3e3beabf42ff9aae385a20dbf7eb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:36.289894 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3e3e3beabf42ff9aae385a20dbf7eb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:36.290340 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3e3e3beabf42ff9aae385a20dbf7eb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:36.359095 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3e3e3beabf42ff9aae385a20dbf7eb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:36.377285 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1447/2874] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:36 2022] DELETE /identity/v3/users/2d3e3e3beabf42ff9aae385a20dbf7eb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:36.382340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:36.386329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:36.386329 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:36.400223 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:36.401475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:36.458680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1428/2875] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:10:36.468296 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:36.469728 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:36.529664 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b77e-e5ee-417c-9434-8ba68e05821b admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:36.533475 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:36.534136 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:36.534422 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:36.534702 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:36.544389 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:36.545896 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:36.557121 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1448/2876] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:36.958873 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:36.960482 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:36.973270 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083a5a-0901-4382-845d-9ec5402c06e0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:36.978465 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:36.979598 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:36.979910 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:36.980183 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] PATH_INFO: `/v3/projects/0950170c6a98448db5f7dfc887b5186d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:36.982141 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0950170c6a98448db5f7dfc887b5186d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:36.984058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:37.085876 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0950170c6a98448db5f7dfc887b5186d', 'request_id': 'req-9950eb2c-deb9-4c79-841e-eb064b2a0c71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:37.141237 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0950170c6a98448db5f7dfc887b5186d', 'request_id': 'req-9950eb2c-deb9-4c79-841e-eb064b2a0c71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:37.148139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0950170c6a98448db5f7dfc887b5186d', 'request_id': 'req-9950eb2c-deb9-4c79-841e-eb064b2a0c71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:37.158473 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] The token cache is being invalidate because project 0950170c6a98448db5f7dfc887b5186d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:37.158763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:37.159535 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:37.161815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1429/2877] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:36 2022] DELETE /identity/v3/projects/0950170c6a98448db5f7dfc887b5186d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:46.551174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:47.155343 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:53.852312 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:53.853726 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:53.972967 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dbda2-ac61-48f1-b3c6-857f40d47bb3 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:54.041250 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:54.042012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:54.042304 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:54.042652 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:54.044818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:54.057794 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:54.059374 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:54.070222 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1449/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:54.491935 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:54.493539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:54.534632 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950eb2c-deb9-4c79-841e-eb064b2a0c71 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:54.539854 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:54.540502 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:54.540815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:54.541094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:54.542885 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:54.554760 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:54.556339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:54.566262 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1430/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:54.661247 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:54.662777 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:54.716638 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=100 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:54.761778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372e41-bc9a-464f-ba62-fb1783ee9e9f service placement] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:54.766357 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:54.767226 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:54.767514 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:54.767795 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] PATH_INFO: `/v3/users/997acb02a3454b2b928dd66f831b4a52` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:54.769171 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=997acb02a3454b2b928dd66f831b4a52)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:54.773710 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:54.983789 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997acb02a3454b2b928dd66f831b4a52'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:54.990771 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997acb02a3454b2b928dd66f831b4a52'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:54.992534 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997acb02a3454b2b928dd66f831b4a52'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:54.993185 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997acb02a3454b2b928dd66f831b4a52'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.089751 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997acb02a3454b2b928dd66f831b4a52'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.107841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1450/2880] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:54 2022] DELETE /identity/v3/users/997acb02a3454b2b928dd66f831b4a52 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:55.397339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:55.408624 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36948-8210-4f66-809d-15e67c11b82a service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:55.464900 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:55.465775 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:55.466058 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:55.466339 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] PATH_INFO: `/v3/projects/5dfff20955284dd7bd2c012e5079798f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:55.467566 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfff20955284dd7bd2c012e5079798f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:55.469536 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:55.580480 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfff20955284dd7bd2c012e5079798f', 'request_id': 'req-0517c3e4-595a-4b82-9978-6bd6c04443e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.655805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfff20955284dd7bd2c012e5079798f', 'request_id': 'req-0517c3e4-595a-4b82-9978-6bd6c04443e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.662153 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfff20955284dd7bd2c012e5079798f', 'request_id': 'req-0517c3e4-595a-4b82-9978-6bd6c04443e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.673314 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] The token cache is being invalidate because project 5dfff20955284dd7bd2c012e5079798f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:55.673601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.674236 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.675787 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1431/2881] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:55 2022] DELETE /identity/v3/projects/5dfff20955284dd7bd2c012e5079798f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:55.680284 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:55.681739 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:55.695028 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447815ba-de88-4367-a7f4-d5b7b33ad5ca admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:55.751524 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:55.752398 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:55.752696 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:55.752992 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] PATH_INFO: `/v3/users/5e6d02bfbea54a36af2390f87aaa168e` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:55.754178 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6d02bfbea54a36af2390f87aaa168e)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:55.756093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:55.955688 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:55.965049 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6d02bfbea54a36af2390f87aaa168e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.971682 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6d02bfbea54a36af2390f87aaa168e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.972332 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6d02bfbea54a36af2390f87aaa168e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:55.972955 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6d02bfbea54a36af2390f87aaa168e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.076478 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-cdc3d70b-5541-438d-86e9-f208beca66e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6d02bfbea54a36af2390f87aaa168e'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.094800 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1451/2882] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:10:55 2022] DELETE /identity/v3/users/5e6d02bfbea54a36af2390f87aaa168e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:56.348997 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:56.350680 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:56.371862 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c3e4-595a-4b82-9978-6bd6c04443e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:56.423481 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:56.432846 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:56.435529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:56.435529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:56.435529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] PATH_INFO: `/v3/projects/895f9fca68fd49d3aba3edb6fc74d198` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:56.435529 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895f9fca68fd49d3aba3edb6fc74d198)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:56.437485 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:56.556898 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895f9fca68fd49d3aba3edb6fc74d198', 'request_id': 'req-4668356b-c321-4b5f-9454-ea889217f899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.689555 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895f9fca68fd49d3aba3edb6fc74d198', 'request_id': 'req-4668356b-c321-4b5f-9454-ea889217f899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.696975 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895f9fca68fd49d3aba3edb6fc74d198', 'request_id': 'req-4668356b-c321-4b5f-9454-ea889217f899'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.707628 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] The token cache is being invalidate because project 895f9fca68fd49d3aba3edb6fc74d198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:10:56.707916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.708553 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4668356b-c321-4b5f-9454-ea889217f899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:10:56.710303 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1432/2883] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:10:56 2022] DELETE /identity/v3/projects/895f9fca68fd49d3aba3edb6fc74d198 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:56.715287 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:56.715582 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:56.716009 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:56.763480 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:56.764733 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:56.823804 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1452/2884] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:56.831636 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:56.831927 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:56.832208 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:56.852697 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:56.853913 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:56.861791 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1433/2885] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:56.865886 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:56.876563 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd1cf-1aff-4379-a9b0-6188e1ea013d None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:56.881140 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:56.881883 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:56.882197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:56.882507 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:56.883240 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:10:56.883550 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:56.885174 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:56.896921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1453/2886] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 5 13:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:10:56.901238 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:56.910446 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057ea7-81fc-4066-97c9-38ae309acd44 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:56.915712 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:56.916361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:56.916644 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:56.916958 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:56.917655 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:56.919607 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.012358 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1434/2887] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 5 13:10:56 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:57.016442 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:57.027666 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b480-f483-4905-94d3-02712b3505ae admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:57.083695 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:57.084325 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.084598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.085978 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] PATH_INFO: `/v3/users` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.086714 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:57.088659 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.170370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1454/2888] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 5 13:10:57 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:10:57.174475 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:57.185297 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcad92-ec82-41f3-848c-e2d872f4aaab admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:57.190110 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:57.190806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.191096 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.191474 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.192239 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:57.193932 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.204532 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1435/2889] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:57.208608 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:57.219272 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c536d-3a13-4a5e-9fa6-81a05cd58e3c admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:57.224217 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:57.224911 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.225204 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.226188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.226953 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:57.228585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbd09-770c-452f-aeb5-3b6f668ddca2 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.230716 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:57.239469 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1455/2890] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 5 13:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:10:57.243720 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:57.253851 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec60-231a-4715-913a-b9136379ac88 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:57.259050 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:57.259931 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.260216 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.260495 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] PATH_INFO: `/v3/projects/133ace0eef5e4f05a01d9eceaee3f43a/users/770ea670d2344988b37ec0b3b143c51a/roles/e5abf678ad64422b8b09aa3e41a2befe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.275378 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=133ace0eef5e4f05a01d9eceaee3f43a, user_id=770ea670d2344988b37ec0b3b143c51a, role_id=e5abf678ad64422b8b09aa3e41a2befe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:57.278054 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.353739 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1436/2891] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 5 13:10:57 2022] PUT /identity/v3/projects/133ace0eef5e4f05a01d9eceaee3f43a/users/770ea670d2344988b37ec0b3b143c51a/roles/e5abf678ad64422b8b09aa3e41a2befe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:10:57.363887 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bcc2-3be1-4f01-93c7-941696e45f2c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.364183 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bcc2-3be1-4f01-93c7-941696e45f2c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.364462 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bcc2-3be1-4f01-93c7-941696e45f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.391458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-98d0bcc2-3be1-4f01-93c7-941696e45f2c None None] MFA Rules not processed for user `770ea670d2344988b37ec0b3b143c51a`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:57.392660 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-98d0bcc2-3be1-4f01-93c7-941696e45f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:57.457025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1456/2892] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:57.468763 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:10:57.470452 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:57.527361 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e578bfa-4d22-498f-9470-ecc18efbb1ea admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:10:57.531068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4dafecd5b64ac6bbc26ac0a236ebfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:10:57.531718 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:57.532006 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:57.532286 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:57.540868 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:10:57.542307 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e3b05-3f63-40d7-95c2-a00d7bf005d0 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:10:57.551144 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1437/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:10:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:10:59.264202 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:59.264763 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:59.264882 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:59.282555 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] MFA Rules not processed for user `770ea670d2344988b37ec0b3b143c51a`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:59.283694 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:59.291201 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1457/2894] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:07.547101 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:09.277322 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=36 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:16.825044 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748855-0a1f-4c6c-b20c-6039bcbfcce4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:16.825574 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748855-0a1f-4c6c-b20c-6039bcbfcce4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:16.825688 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748855-0a1f-4c6c-b20c-6039bcbfcce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:16.858007 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-03748855-0a1f-4c6c-b20c-6039bcbfcce4 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:16.859232 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-03748855-0a1f-4c6c-b20c-6039bcbfcce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:16.921572 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1438/2895] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:17.087907 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:17.089352 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:17.159683 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922356-e5bf-4a35-bbfe-6ebb5fa84da3 None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:17.165768 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:17.166435 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:17.166724 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:17.167006 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:17.175543 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:17.177177 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:17.186487 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1458/2896] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:18.414426 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20596-329c-4d00-88e9-63b0f2e95800 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:18.414908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20596-329c-4d00-88e9-63b0f2e95800 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:18.415016 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20596-329c-4d00-88e9-63b0f2e95800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:18.432965 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7bd20596-329c-4d00-88e9-63b0f2e95800 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:18.434139 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7bd20596-329c-4d00-88e9-63b0f2e95800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:18.441250 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1439/2897] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:18.453109 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:18.463721 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb782ee-324c-46a0-9f02-72633281329a service swift] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:18.468859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:18.469503 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:18.469818 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:18.470097 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:18.478706 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:18.480276 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:18.488152 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1459/2898] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:19.026031 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd331a8-c1b4-4a64-a2db-416bf205278d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:19.026159 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd331a8-c1b4-4a64-a2db-416bf205278d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:19.026340 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd331a8-c1b4-4a64-a2db-416bf205278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:19.043812 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1bd331a8-c1b4-4a64-a2db-416bf205278d None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:19.045041 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1bd331a8-c1b4-4a64-a2db-416bf205278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:19.052070 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1440/2899] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 5 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:19.064111 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:19.075737 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07fca8-8632-44b3-b512-3e0c62bd0bdd service swift] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:19.081037 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:19.081680 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:19.081971 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:19.082291 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:19.091254 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:19.092905 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:19.101930 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1460/2900] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:19.606186 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:19.606675 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:19.606785 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:19.624980 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] MFA Rules not processed for user `158d55f449004896bd0abccbadbc48e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:19.626169 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:19.633789 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1441/2901] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 5 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:19.645545 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:19.657025 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321b60-1fbc-459c-a27c-56a524c0b854 service swift] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:19.661965 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7088e558ef4e778441a295dbf23500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:19.662599 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:19.664066 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:19.664351 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:19.672784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:19.674370 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e23eb-022a-4ab1-99bc-ecc8dd4413e3 service swift] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:19.682625 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1461/2902] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:22.390702 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:22.451872 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7a07c-aeca-465c-be19-d07cd068f689 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:22.456519 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:22.457425 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:22.457713 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:22.457991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] PATH_INFO: `/v3/users/770ea670d2344988b37ec0b3b143c51a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:22.459214 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] RBAC: Authorizing `identity:delete_user(user_id=770ea670d2344988b37ec0b3b143c51a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:22.461908 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:22.640119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770ea670d2344988b37ec0b3b143c51a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:22.640711 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770ea670d2344988b37ec0b3b143c51a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:22.641328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770ea670d2344988b37ec0b3b143c51a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:22.648094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770ea670d2344988b37ec0b3b143c51a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:22.700805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770ea670d2344988b37ec0b3b143c51a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:22.708172 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:22.718890 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1442/2903] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:11:22 2022] DELETE /identity/v3/users/770ea670d2344988b37ec0b3b143c51a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:22.723377 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] REQUEST_METHOD: `POST` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:22.723841 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:22.723940 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:22.741103 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.auth.core [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] MFA Rules not processed for user `c80e1d4e886445cc85f651f6ae073c71`. Rule list: `[]` (Enabled: `True`). {{(pid=86703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:22.747379 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:22.803929 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1462/2904] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 5 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:22.813635 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:22.815062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:22.896656 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd486046-0cde-4f64-bca4-db7f222132af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:22.901104 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:22.901779 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:22.902066 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:22.902366 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:22.911489 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:22.913105 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:22.922755 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1443/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:11:23.198188 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:23.199657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:23.214131 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e6f9b-800b-41ea-a5d4-515febabf36c None None] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:23.219094 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:23.220054 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:23.222409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:23.222409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] PATH_INFO: `/v3/projects/133ace0eef5e4f05a01d9eceaee3f43a` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:23.222409 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=133ace0eef5e4f05a01d9eceaee3f43a)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:23.223859 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:23.565956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:23.568626 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133ace0eef5e4f05a01d9eceaee3f43a', 'request_id': 'req-5630830d-8dbd-4f38-921f-ad30d0c850fb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:23.683198 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133ace0eef5e4f05a01d9eceaee3f43a', 'request_id': 'req-5630830d-8dbd-4f38-921f-ad30d0c850fb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:23.689784 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133ace0eef5e4f05a01d9eceaee3f43a', 'request_id': 'req-5630830d-8dbd-4f38-921f-ad30d0c850fb'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:23.700427 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] The token cache is being invalidate because project 133ace0eef5e4f05a01d9eceaee3f43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:11:23.700770 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:23.701412 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:23.702956 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1463/2906] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:11:23 2022] DELETE /identity/v3/projects/133ace0eef5e4f05a01d9eceaee3f43a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:32.918387 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=39,keystone:DELETE=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:33.741093 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:10.906666 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:10.908151 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:10.998639 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13db7-61cf-4944-a6a9-aa690948d176 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:11.058020 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:11.058696 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:11.058991 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:11.059274 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:11.061119 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:11.073198 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:11.077129 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:11.086230 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1444/2907] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:12.514012 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:12.515474 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:12.572328 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630830d-8dbd-4f38-921f-ad30d0c850fb admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:12.576405 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:12.577086 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:12.577375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:12.577656 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:12.579446 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:12.589966 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:12.591403 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:12.599557 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1464/2908] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:13.961498 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:13.971257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642c36e-0785-44a0-a833-4423f5ffd5eb service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:13.974984 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:13.975641 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:13.975924 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:13.976257 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:13.978094 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:13.989022 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:13.993891 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:14.000433 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1445/2909] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:14.078246 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:14.087105 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f6-5973-4b42-94cd-3f3df7c6a545 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:14.090990 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:14.091632 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:14.091921 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:14.092209 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:14.094031 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:14.177778 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:14.179229 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:14.199764 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1465/2910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:23.996062 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=73 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:24.196646 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=69 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:14:00.895582 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:00.904370 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20d89c-efce-489b-ae48-be46bad63587 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:00.907959 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:00.908597 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:00.908916 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:00.909187 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:00.910944 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:00.969455 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:00.970936 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:00.979963 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1446/2911] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:14:02.229598 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:02.238531 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0694f-770b-432d-9f50-af797530bdbe service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:02.242425 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:02.243102 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:02.243375 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:02.243657 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:02.245590 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:02.260042 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:02.262100 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:02.273725 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1466/2912] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:14:06.319968 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:06.328853 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e839a-3de1-4a51-97c3-6e729b6a4c44 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:06.332539 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f2aac78555431ca685e3b43d27b099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:06.333215 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:06.333505 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:06.333782 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:06.335552 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:06.398601 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:06.400068 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:06.410392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1447/2913] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:14:12.268585 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=6 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:14:13.473756 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:13.475323 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:13.489715 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2133c-386e-42d1-bd88-2894baaa4c95 service neutron] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:13.494371 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:13.495987 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:13.496826 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:13.497023 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] PATH_INFO: `/v3/users/9811824bfe694897a247e8afa370d8ef` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:13.498262 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9811824bfe694897a247e8afa370d8ef)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:13.500197 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:13.685429 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9811824bfe694897a247e8afa370d8ef'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:13.692230 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9811824bfe694897a247e8afa370d8ef'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:13.692934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9811824bfe694897a247e8afa370d8ef'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:13.693554 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9811824bfe694897a247e8afa370d8ef'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:13.777579 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9811824bfe694897a247e8afa370d8ef'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:13.795415 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1467/2914] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:14:13 2022] DELETE /identity/v3/users/9811824bfe694897a247e8afa370d8ef => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:14:14.047805 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:14.058328 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741a6b-b1a1-43e1-bd1e-368f990f46cf service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:14.114955 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:14.115828 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:14.116114 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:14.116392 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] PATH_INFO: `/v3/projects/7e2732b6787e4132a74777b00567e9d5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:14.117611 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2732b6787e4132a74777b00567e9d5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:14.119507 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:14.207815 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:14:14.217631 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2732b6787e4132a74777b00567e9d5', 'request_id': 'req-21719679-6361-4f48-9475-f394ec823733'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.317279 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2732b6787e4132a74777b00567e9d5', 'request_id': 'req-21719679-6361-4f48-9475-f394ec823733'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.324618 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2732b6787e4132a74777b00567e9d5', 'request_id': 'req-21719679-6361-4f48-9475-f394ec823733'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.334942 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] The token cache is being invalidate because project 7e2732b6787e4132a74777b00567e9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:14:14.335225 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.335842 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.337419 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1448/2915] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:14:14 2022] DELETE /identity/v3/projects/7e2732b6787e4132a74777b00567e9d5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:14:14.341964 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:14.343458 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:14.356934 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166733f0-1dc2-4066-bf93-6fc031eb8451 admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:14.413383 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:14.414267 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:14.414553 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:14.414843 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] PATH_INFO: `/v3/users/629d2001827c40bb956bf4df3a32bd9d` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:14.416052 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=629d2001827c40bb956bf4df3a32bd9d)` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:14.418043 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:14.594167 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629d2001827c40bb956bf4df3a32bd9d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.601137 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629d2001827c40bb956bf4df3a32bd9d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.601805 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629d2001827c40bb956bf4df3a32bd9d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.602426 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629d2001827c40bb956bf4df3a32bd9d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.671722 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.notifications [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629d2001827c40bb956bf4df3a32bd9d'} {{(pid=86703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:14.679630 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:14:14.690224 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1468/2916] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 5 13:14:14 2022] DELETE /identity/v3/users/629d2001827c40bb956bf4df3a32bd9d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:14:14.958665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:14:14.958665 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:14:14.973278 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719679-6361-4f48-9475-f394ec823733 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:14:15.033643 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c80e1d4e886445cc85f651f6ae073c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ba694b123b4c2a9ad28d0d2ae13d58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:14:15.034522 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:14:15.034806 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:14:15.035080 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] PATH_INFO: `/v3/projects/c00668c6b0524087a14d740eed033a5f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:14:15.036266 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00668c6b0524087a14d740eed033a5f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:14:15.038194 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:14:15.148899 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00668c6b0524087a14d740eed033a5f', 'request_id': 'req-f6e01465-ea4b-4d92-bd38-c603ff6980b4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:15.228912 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00668c6b0524087a14d740eed033a5f', 'request_id': 'req-f6e01465-ea4b-4d92-bd38-c603ff6980b4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:15.235988 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00668c6b0524087a14d740eed033a5f', 'request_id': 'req-f6e01465-ea4b-4d92-bd38-c603ff6980b4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:15.247448 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] The token cache is being invalidate because project c00668c6b0524087a14d740eed033a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:14:15.247971 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:15.249029 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f6e01465-ea4b-4d92-bd38-c603ff6980b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:14:15.251273 dv-cinder-797608-48-smb devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1449/2917] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 5 13:14:14 2022] DELETE /identity/v3/projects/c00668c6b0524087a14d740eed033a5f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:14:24.869225 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:14:25.243199 dv-cinder-797608-48-smb devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:17:48.179613 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Authenticating user token {{(pid=86703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:17:48.181055 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:17:48.250653 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c370b7-edfd-4393-a4e1-92eee5f3fd8d admin admin] Validating token access rules against request {{(pid=86703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:17:48.309912 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48d9e605e242d19446c497bde122f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a949286664639960c0028fe634a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:17:48.310485 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] REQUEST_METHOD: `GET` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:17:48.310767 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] SCRIPT_NAME: `/identity` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:17:48.311064 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:17:48.312869 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.fernet_utils [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:17:48.324593 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:17:48.326263 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8cbf-fee6-4ae2-a515-99c9edf9a39e service placement] RBAC: Authorization granted {{(pid=86703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:17:48.336289 dv-cinder-797608-48-smb devstack@keystone.service[86703]: [pid: 86703|app: 0|req: 1469/2918] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 5 13:17:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:17:58.332067 dv-cinder-797608-48-smb devstack@keystone.service[86703]: DEBUG dbcounter [-] [86703] Writing DB stats keystone:SELECT=58 {{(pid=86703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}